Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-gb7jv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-gb7jv to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-h55xg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-kgvsk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-kgvsk to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-l54fd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-l54fd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-mjrfr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-mm2ds

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mm2ds to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-rs4mw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-rvn8p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rvn8p to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-skrdd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-skrdd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-tskjl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-tskjl to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-x8nhb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-x8nhb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-j82zb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-j82zb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-8t2kn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-8t2kn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-pz258 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-8shrm to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-95rfd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5p6pr to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-7ddcd68ff8-rjfdr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5vd6w4 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-24dg4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-7ddcd68ff8-ckxc2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ddcd68ff8-ckxc2 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

router-default-d5df879b9-lxqd6

Scheduled

Successfully assigned openshift-ingress/router-default-d5df879b9-lxqd6 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

router-default-d5df879b9-lxqd6

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

router-default-d5df879b9-lxqd6

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-4h2lv

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-4h2lv to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-95j59

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95j59 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-zhc8j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-fkv8m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-d5df879b9 from 0 to 1

openshift-ingress

replicaset-controller

router-default-d5df879b9

SuccessfulCreate

Created pod: router-default-d5df879b9-lxqd6
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

Created

Container created

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

Started

Container started

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-d5df879b9-lxqd6

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-zhc8j

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-zhc8j

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.362s (4.362s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-64dd656c99

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-tskjl

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-64dd656c99 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-tskjl

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.58s (4.58s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.561s (4.561s including waiting). Image size: 183555333 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

kube-auth-proxy-7ddcd68ff8-rjfdr

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7ddcd68ff8 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

kube-auth-proxy-7ddcd68ff8

SuccessfulCreate

Created pod: kube-auth-proxy-7ddcd68ff8-ckxc2

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-649697ffd5 from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-649697ffd5

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

openshift-ingress

replicaset-controller

kube-auth-proxy-7ddcd68ff8

SuccessfulCreate

Created pod: kube-auth-proxy-7ddcd68ff8-rjfdr

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-7ddcd68ff8-ckxc2

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.337s (3.337s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.34s (3.34s including waiting). Image size: 188904677 bytes.

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-hkbfq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-zhc8j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Unhealthy

Readiness probe failed: Get "http://10.134.0.17:8080/ready": dial tcp 10.134.0.17:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

ProbeError

Readiness probe error: Get "http://10.134.0.17:8080/ready": dial tcp 10.134.0.17:8080: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-j82zb

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-4h2lv
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-j82zb

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-4h2lv

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.16s (3.16s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.118s (3.118s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-skrdd

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-skrdd

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.33s (4.33s including waiting). Image size: 183555333 bytes.
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-95j59

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-95rfd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-95j59

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-95rfd

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.827s (3.827s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-8t2kn

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 4 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-8t2kn

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-migrate-53cc8e62-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-53cc8e62-gw

openshift-ingress

gateway_labeler_controller

e2e-ait-09e3828d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-09e3828d

openshift-ingress

gateway_labeler_controller

e2e-ait-2b62c067

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2b62c067

openshift-ingress

deployment-controller

e2e-ait-2b62c067-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2b62c067-openshift-default-f85b48b9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2b62c067-openshift-default-f85b48b9c

SuccessfulCreate

Created pod: e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

openshift-ingress

deployment-controller

e2e-migrate-53cc8e62-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65 from 0 to 1

openshift-ingress

multus

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-09e3828d-openshift-default-54b654cff9

SuccessfulCreate

Created pod: e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

openshift-ingress

replicaset-controller

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65

SuccessfulCreate

Created pod: e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

openshift-ingress

multus

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-09e3828d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-09e3828d-openshift-default-54b654cff9 from 0 to 1

openshift-ingress

multus

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2b62c067

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2b62c067-8ddd9b947 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b62c067: serviceaccount "payload-processing-e2e-ait-2b62c067" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b62c067-8ddd9b947

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2b62c067

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b62c067-8ddd9b947

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2b62c067-8ddd9b947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b62c067: serviceaccount "payload-processing-e2e-ait-2b62c067" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-d0628e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-d0628e

openshift-ingress

multus

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Started

Container started

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-16457c0e-openshift-default-68984cb5df

SuccessfulCreate

Created pod: e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

openshift-ingress

deployment-controller

e2e-derive-16457c0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-16457c0e-openshift-default-68984cb5df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-16457c0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-16457c0e

openshift-ingress

gateway_labeler_controller

e2e-ait-2e734c1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2e734c1c

openshift-ingress

deployment-controller

e2e-ait-2e734c1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2e734c1c-openshift-default-64c45c6cd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2e734c1c-openshift-default-64c45c6cd9

SuccessfulCreate

Created pod: e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

openshift-ingress

multus

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-09e3828d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-09e3828d-648d8764c7 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-09e3828d: serviceaccount "payload-processing-e2e-ait-09e3828d" not found

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-e6ca80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-e6ca80

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-09e3828d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-09e3828d-648d8764c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-09e3828d-648d8764c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-09e3828d: serviceaccount "payload-processing-e2e-ait-09e3828d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-09e3828d-648d8764c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Started

Container started

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-53cc8e62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-53cc8e62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-53cc8e62-74b7cc9b55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-53cc8e62: serviceaccount "payload-processing-e2e-migrate-53cc8e62" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-53cc8e62: serviceaccount "payload-processing-e2e-migrate-53cc8e62" not found

openshift-ingress

multus

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.133s (3.134s including waiting). Image size: 125353963 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-d0628e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-d0628e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-d0628e: serviceaccount "payload-processing-e2e-worker-w1-d0628e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-d0628e: serviceaccount "payload-processing-e2e-worker-w1-d0628e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2e734c1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2e734c1c-7546bf48b7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2e734c1c-7546bf48b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2e734c1c-7546bf48b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2e734c1c: serviceaccount "payload-processing-e2e-ait-2e734c1c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2e734c1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2e734c1c: serviceaccount "payload-processing-e2e-ait-2e734c1c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2e734c1c-7546bf48b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-16457c0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-16457c0e-6f9bf4dfb9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-16457c0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-16457c0e: serviceaccount "payload-processing-e2e-derive-16457c0e" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-16457c0e: serviceaccount "payload-processing-e2e-derive-16457c0e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-e6ca80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-e6ca80-699dc489fc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e6ca80-699dc489fc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-e6ca80-699dc489fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e6ca80: serviceaccount "payload-processing-e2e-worker-w0-e6ca80" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-e6ca80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e6ca80-699dc489fc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e6ca80: serviceaccount "payload-processing-e2e-worker-w0-e6ca80" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.647s (2.647s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:45742->10.132.0.59:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:45742->10.132.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-10d2fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-10d2fb

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-53cc8e62-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-53cc8e62-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-10d2fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-10d2fb-6bd458c589 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-10d2fb: serviceaccount "payload-processing-e2e-worker-w2-10d2fb" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-10d2fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-10d2fb-6bd458c589

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-10d2fb-6bd458c589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-10d2fb: serviceaccount "payload-processing-e2e-worker-w2-10d2fb" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-10d2fb-6bd458c589

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

openshift-ingress

multus

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Started

Container started

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w5-9d77b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-9d77b6

openshift-ingress

multus

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulCreate

Created pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w5-9d77b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w5-9d77b6-869d7d4b59 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-9d77b6: serviceaccount "payload-processing-e2e-worker-w5-9d77b6" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-9d77b6: serviceaccount "payload-processing-e2e-worker-w5-9d77b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w5-9d77b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-108cf9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-108cf9

openshift-ingress

multus

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 0 to 1

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-worker-w6-096685

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-096685

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-108cf9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-108cf9-7c4649d4cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-108cf9: serviceaccount "payload-processing-e2e-worker-w3-108cf9" not found

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-108cf9: serviceaccount "payload-processing-e2e-worker-w3-108cf9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-108cf9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w6-096685

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w6-096685-7b87f87d87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w6-096685

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w6-096685-68c968b4c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-096685: serviceaccount "payload-processing-e2e-worker-w6-096685" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w6-096685-68c968b4c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w6-096685-68c968b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-096685: serviceaccount "payload-processing-e2e-worker-w6-096685" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w6-096685-68c968b4c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:40728->10.134.0.37:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:40728->10.134.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Created

Container created

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-8e6407

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-8e6407

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 0 to 1

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-8e6407

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-8e6407

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8e6407: serviceaccount "payload-processing-e2e-worker-w4-8e6407" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8e6407: serviceaccount "payload-processing-e2e-worker-w4-8e6407" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-skrdd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 2 to 3

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Started

Container started

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Created

Container created

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-95j59

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulCreate

Created pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-95rfd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 2 to 3

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Started

Container started

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 2 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-8t2kn

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 3 to 5

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

openshift-ingress

gateway_labeler_controller

e2e-mt-cba6f9af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cba6f9af
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 0 to 1

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cba6f9af-767f954cd7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cba6f9af-767f954cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulCreate

Created pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 2 to 3

openshift-ingress

multus

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 3 to 4

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-f5bb4f-openshift-default-5f5c77b87

SuccessfulCreate

Created pod: e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

openshift-ingress

deployment-controller

e2e-api-a-f5bb4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f5bb4f-openshift-default-5f5c77b87 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-f5bb4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f5bb4f

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 2 to 3

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 1 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-fkv8m

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-l54fd

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-fkv8m

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-l54fd

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-b26f03-openshift-default-7d5d7795c5

SuccessfulCreate

Created pod: e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

openshift-ingress

deployment-controller

e2e-api-a-b26f03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b26f03-openshift-default-7d5d7795c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b26f03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b26f03

openshift-ingress

multus

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f5bb4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f5bb4f-697d79c597 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f5bb4f: serviceaccount "payload-processing-e2e-api-a-f5bb4f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f5bb4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f5bb4f-697d79c597

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f5bb4f-697d79c597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f5bb4f: serviceaccount "payload-processing-e2e-api-a-f5bb4f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f5bb4f-697d79c597

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 5 to 7

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b26f03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b26f03-97b5f4d87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b26f03-5cc97cdb97

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b26f03: serviceaccount "payload-processing-e2e-api-a-b26f03" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b26f03-5cc97cdb97

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b26f03-5cc97cdb97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b26f03: serviceaccount "payload-processing-e2e-api-a-b26f03" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b26f03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b26f03-5cc97cdb97 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 7 to 10

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Started

Container started

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

ProbeError

Readiness probe error: Get "http://10.132.0.113:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Unhealthy

Readiness probe failed: Get "http://10.132.0.113:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 3 to 5

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

openshift-ingress

replicaset-controller

e2e-api-a-00cc0e-openshift-default-748c64f44c

SuccessfulCreate

Created pod: e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

openshift-ingress

deployment-controller

e2e-api-a-00cc0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-00cc0e-openshift-default-748c64f44c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-00cc0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-00cc0e
(x6)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-19ee94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-19ee94

openshift-ingress

replicaset-controller

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7

SuccessfulCreate

Created pod: e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-19ee94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-bca68b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bca68b-openshift-default-5b84bcc475 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-bca68b-openshift-default-5b84bcc475

SuccessfulCreate

Created pod: e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bca68b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bca68b

openshift-ingress

multus

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-b-a25202

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a25202

openshift-ingress

replicaset-controller

e2e-api-b-a25202-openshift-default-745bcccd99

SuccessfulCreate

Created pod: e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

openshift-ingress

deployment-controller

e2e-api-b-a25202-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a25202-openshift-default-745bcccd99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-00cc0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-00cc0e-649cc67649 from 0 to 1

openshift-ingress

multus

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-00cc0e: serviceaccount "payload-processing-e2e-api-a-00cc0e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-00cc0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-00cc0e-649cc67649

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-00cc0e-649cc67649

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-00cc0e-649cc67649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-00cc0e: serviceaccount "payload-processing-e2e-api-a-00cc0e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bca68b-5948b5c78f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-5948b5c78f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bca68b-5948b5c78f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-5948b5c78f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a25202

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a25202-7f74f7945 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a25202

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a25202-8c9b8c975 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a25202-8c9b8c975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a25202-8c9b8c975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a25202: serviceaccount "payload-processing-e2e-api-b-a25202" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a25202-7f74f7945

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a25202-7f74f7945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a25202: serviceaccount "payload-processing-e2e-api-b-a25202" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a25202-8c9b8c975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a25202-7f74f7945

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulDelete

Deleted pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulDelete

Deleted pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 4 to 2

openshift-ingress

deployment-controller

e2e-api-b-c7f7d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f

SuccessfulCreate

Created pod: e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

openshift-ingress

gateway_labeler_controller

e2e-api-b-c7f7d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c7f7d7

openshift-ingress

multus

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-19ee94-5b695cbd99 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5b695cbd99

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-19ee94-5b695cbd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5b695cbd99

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

openshift-ingress

multus

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-5p6pr

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 7.128s (7.128s including waiting). Image size: 185476477 bytes.

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-t7927

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c7f7d7: serviceaccount "payload-processing-e2e-api-b-c7f7d7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c7f7d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c7f7d7-6cdd9b9465 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c7f7d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c7f7d7: serviceaccount "payload-processing-e2e-api-b-c7f7d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-69a9bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-69a9bb

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69a9bb-56d6547467 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-56d6547467

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-56d6547467

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69a9bb-56d6547467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-b9eea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9eea3-openshift-default-557d9d8589 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Unhealthy

Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-b-b9eea3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b9eea3

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

ProbeError

Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b9eea3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b9eea3-f4ff45995 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b9eea3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b9eea3-786cd56d67 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9eea3: serviceaccount "payload-processing-e2e-api-b-b9eea3" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b9eea3-f4ff45995

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b9eea3-f4ff45995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9eea3: serviceaccount "payload-processing-e2e-api-b-b9eea3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b9eea3-f4ff45995

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 4 to 3

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulDelete

Deleted pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulDelete

Deleted pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c17125

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c17125

openshift-ingress

deployment-controller

e2e-ipp-b-c17125-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c17125-openshift-default-58cf794799 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c17125-openshift-default-58cf794799

SuccessfulCreate

Created pod: e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

openshift-ingress

multus

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c17125

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c17125-c9cfb7b45 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c17125

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c17125-c9cfb7b45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c17125-c9cfb7b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c17125: serviceaccount "payload-processing-e2e-ipp-b-c17125" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c17125: serviceaccount "payload-processing-e2e-ipp-b-c17125" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c17125-c9cfb7b45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-b6a289-openshift-default-5cfd69676f

SuccessfulCreate

Created pod: e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

openshift-ingress

deployment-controller

e2e-ipp-b-b6a289-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b6a289-openshift-default-5cfd69676f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b6a289

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b6a289

openshift-ingress

multus

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Started

Container started

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Started

Container started

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Started

Container started

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b6a289

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b6a289-59d8578bc5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6a289: serviceaccount "payload-processing-e2e-ipp-b-b6a289" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6a289-59d8578bc5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b6a289-59d8578bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6a289: serviceaccount "payload-processing-e2e-ipp-b-b6a289" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6a289-59d8578bc5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b6a289

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-fkv8m

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bca68b-576d767654 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-576d767654

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bca68b-576d767654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-576d767654

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.922s (1.922s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.41s (2.41s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Started

Container started

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 4 to 8

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 8 to 9

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 8 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-19ee94-5bbd659cfb from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cba6f9af-767f954cd7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cba6f9af-767f954cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulDelete

Deleted pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 3 to 2

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 5 to 3

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulDelete

Deleted pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 4 to 2

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulDelete

Deleted pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 6 to 5

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Unhealthy

Readiness probe failed: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

ProbeError

Readiness probe error: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69a9bb-749666bffb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-749666bffb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69a9bb-749666bffb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found
(x2)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-b9eea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9eea3-openshift-default-557d9d8589 from 1 to 4

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Created

Container created

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Created

Container created

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Created

Container created

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-749666bffb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-45fc31-openshift-default-9658b4cf7

SuccessfulCreate

Created pod: e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

openshift-ingress

deployment-controller

e2e-ipp-b-45fc31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-45fc31-openshift-default-9658b4cf7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-45fc31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-45fc31

openshift-ingress

multus

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-45fc31-7d5c46c999 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-7d5c46c999

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-45fc31-7d5c46c999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-7d5c46c999

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-api-b-b9eea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9eea3-openshift-default-557d9d8589 from 4 to 6

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Created

Container created

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Started

Container started

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Started

Container started

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-d51175-openshift-default-647d58c97

SuccessfulCreate

Created pod: e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-a-d51175-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d51175-openshift-default-647d58c97 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d51175

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d51175

openshift-ingress

multus

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d51175-7cb67799f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-77c9b96c4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d51175-77c9b96c4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-77c9b96c4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d51175-77c9b96c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-pz258

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Started

Container started

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

ProbeError

Startup probe error: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Unhealthy

Startup probe failed: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f4516e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f4516e

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9

SuccessfulCreate

Created pod: e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

openshift-ingress

deployment-controller

e2e-praxis-a-f4516e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f4516e-openshift-default-7b5569dcd9 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-785dw

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulDelete

Deleted pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f4516e: serviceaccount "payload-processing-e2e-praxis-a-f4516e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f4516e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f4516e-56c46dd57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f4516e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75 from 0 to 1

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f4516e-56c46dd57

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f4516e-56c46dd57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f4516e: serviceaccount "payload-processing-e2e-praxis-a-f4516e" not found

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f4516e-56c46dd57

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

openshift-ingress

multus

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 9 to 8

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9ceb40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9ceb40

openshift-ingress

deployment-controller

e2e-ipp-a-9ceb40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9ceb40-openshift-default-67b68b47cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc

SuccessfulCreate

Created pod: e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

openshift-ingress

multus

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 8 to 5
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

ProbeError

Readiness probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

ProbeError

Readiness probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Unhealthy

Readiness probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Unhealthy

Readiness probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

ProbeError

Readiness probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Unhealthy

Readiness probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9ceb40-59dfcd476c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 5 to 4

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-45fc31-679598b5b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulDelete

Deleted pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-679598b5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-45fc31-679598b5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 3 to 2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-679598b5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ad4580

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ad4580

openshift-ingress

multus

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-ad4580-openshift-default-5f89696b85

SuccessfulCreate

Created pod: e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

openshift-ingress

deployment-controller

e2e-praxis-b-ad4580-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ad4580-openshift-default-5f89696b85 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ad4580

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ad4580-c6756f6f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad4580-c6756f6f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ad4580-c6756f6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad4580: serviceaccount "payload-processing-e2e-praxis-b-ad4580" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ad4580

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad4580: serviceaccount "payload-processing-e2e-praxis-b-ad4580" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad4580-c6756f6f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4516e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4516e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d51175-7f8f8f648 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-x8nhb

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 2 to 4

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-mjrfr

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-x8nhb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-mjrfr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Created

Container created
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-7f8f8f648

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d51175-7f8f8f648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Created

Container created
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-7f8f8f648

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-rs4mw

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-kgvsk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-gb7jv

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-kgvsk

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-rs4mw

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-gb7jv

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9

SuccessfulCreate

Created pod: e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

openshift-ingress

deployment-controller

e2e-ipp-b-2d5a5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2d5a5a-openshift-default-68b79576d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2d5a5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2d5a5a

openshift-ingress

multus

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-rvn8p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-h55xg

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-mm2ds

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-mm2ds

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-rvn8p

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-h55xg

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc

SuccessfulCreate

Created pod: e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-9ceb40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9ceb40-openshift-default-67b68b47cc from 1 to 2

openshift-ingress

multus

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Unhealthy

Startup probe failed: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

ProbeError

Startup probe error: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.41:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

ProbeError

Readiness probe error: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Unhealthy

Readiness probe failed: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-d91f6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d91f6f-openshift-default-5776c68949 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-d91f6f-openshift-default-5776c68949

SuccessfulCreate

Created pod: e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d91f6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d91f6f

openshift-ingress

multus

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d91f6f-b7bf7884c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d5a5a-79df66d896 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-79df66d896

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d5a5a-79df66d896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-79df66d896

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d91f6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d91f6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-5p6pr

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Unhealthy

Readiness probe failed: Get "http://10.132.0.138:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

ProbeError

Readiness probe error: Get "http://10.132.0.138:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulDelete

Deleted pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d91f6f-7cff4575b from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-7cff4575b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d91f6f-7cff4575b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-7cff4575b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9

SuccessfulCreate

Created pod: e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-8f1e34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8f1e34

openshift-ingress

deployment-controller

e2e-praxis-a-8f1e34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8f1e34: serviceaccount "payload-processing-e2e-praxis-a-8f1e34" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-8f1e34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8f1e34: serviceaccount "payload-processing-e2e-praxis-a-8f1e34" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-8f1e34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-8f1e34-6c697ddb45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Unhealthy

Startup probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

ProbeError

Startup probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-h55xg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-rvn8p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-mm2ds

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-gb7jv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-x8nhb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-l54fd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-bbb1eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-bbb1eb

openshift-ingress

replicaset-controller

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f

SuccessfulCreate

Created pod: e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

openshift-ingress

multus

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-bbb1eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-bbb1eb-openshift-default-6b6876488f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-bbb1eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-bbb1eb-9df7698b5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bbb1eb: serviceaccount "payload-processing-e2e-praxis-b-bbb1eb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-bbb1eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bbb1eb: serviceaccount "payload-processing-e2e-praxis-b-bbb1eb" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bbb1eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bbb1eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-kgvsk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-rs4mw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 3 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target