Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-95j59

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95j59 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-8t2kn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-8t2kn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-7ddcd68ff8-rjfdr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ddcd68ff8-rjfdr to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-7ddcd68ff8-ckxc2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ddcd68ff8-ckxc2 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-fkv8m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-fkv8m to ip-10-0-135-235.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-jph7z

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-jph7z to ip-10-0-136-103.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-5zfvl

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-5zfvl to ip-10-0-136-103.us-west-2.compute.internal

opendatahub

ai-gateway-controller-c9959c9bb-l695c

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-c9959c9bb-l695c to ip-10-0-136-103.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-kwv2h

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-kwv2h to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-ndgmq

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-ndgmq to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-t4whx

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-t4whx to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-64xrk

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-64xrk to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

maas-controller-75695549d4-cp6tv

Scheduled

Successfully assigned opendatahub/maas-controller-75695549d4-cp6tv to ip-10-0-135-235.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k to ip-10-0-139-247.us-west-2.compute.internal

opendatahub

maas-controller-7bb9976d7-w6btv

Scheduled

Successfully assigned opendatahub/maas-controller-7bb9976d7-w6btv to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-fbqk9

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-fbqk9 to ip-10-0-136-103.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-ccqh4

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-ccqh4 to ip-10-0-139-247.us-west-2.compute.internal

opendatahub

test-curl-7355-6b4e7e

Scheduled

Successfully assigned opendatahub/test-curl-7355-6b4e7e to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

test-curl-7355-c9b19c

Scheduled

Successfully assigned opendatahub/test-curl-7355-c9b19c to ip-10-0-135-235.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-dxvdj to ip-10-0-139-247.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-b679c64f6-l58kw

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-l58kw to ip-10-0-136-103.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-b679c64f6-m25l7

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-m25l7 to ip-10-0-139-247.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-b679c64f6-sscc5

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-b679c64f6-sscc5 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5vd6w4 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hkbfq to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5p6pr to ip-10-0-139-247.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-nj5xz

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-nj5xz to ip-10-0-135-235.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s to ip-10-0-135-235.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-zpdbb

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-zpdbb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-zhc8j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-zhc8j to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-gb7jv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-gb7jv to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-h55xg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-h55xg to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-kgvsk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-kgvsk to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-l54fd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-l54fd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn to ip-10-0-136-103.us-west-2.compute.internal

kuadrant-system

authorino-5b7b9b54fb-2b5qg

Scheduled

Successfully assigned kuadrant-system/authorino-5b7b9b54fb-2b5qg to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-mjrfr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mjrfr to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-mm2ds

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-mm2ds to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-rs4mw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rs4mw to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-rvn8p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-rvn8p to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-skrdd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-skrdd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn to ip-10-0-136-103.us-west-2.compute.internal

kuadrant-system

authorino-69dbd95c57-6q7xh

Scheduled

Successfully assigned kuadrant-system/authorino-69dbd95c57-6q7xh to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-tskjl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-tskjl to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt to ip-10-0-135-235.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-jvrbq

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-jvrbq to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-x8nhb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-x8nhb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr to ip-10-0-136-103.us-west-2.compute.internal

kuadrant-system

authorino-dc679f98-zqbjw

Scheduled

Successfully assigned kuadrant-system/authorino-dc679f98-zqbjw to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss to ip-10-0-135-235.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-x7d9h

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-x7d9h to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77 to ip-10-0-136-103.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-45sf7

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-45sf7 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv to ip-10-0-139-247.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-5866c976c5-ksz8q

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-5866c976c5-ksz8q to ip-10-0-136-103.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-lhp52

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-lhp52 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr to ip-10-0-139-247.us-west-2.compute.internal

cert-manager

cert-manager-597b95cb84-clxzt

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-clxzt to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

router-default-d5df879b9-lxqd6

Scheduled

Successfully assigned openshift-ingress/router-default-d5df879b9-lxqd6 to ip-10-0-139-247.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

router-default-d5df879b9-lxqd6

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

router-default-d5df879b9-lxqd6

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-j82zb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-j82zb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx to ip-10-0-135-235.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-hqt9s

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-hqt9s to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9 to ip-10-0-136-103.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-2kkhq

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-2kkhq to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk to ip-10-0-135-235.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-lwl75

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-lwl75 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52 to ip-10-0-136-103.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-2nmjm

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2nmjm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn to ip-10-0-135-235.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-2hmg8

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-2hmg8 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698 to ip-10-0-136-103.us-west-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-hfpsb

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-hfpsb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-t7927 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t to ip-10-0-136-103.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-2n2lb

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-2n2lb to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-769df7846c-95rfd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-769df7846c-95rfd to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-pz258 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-bn64g to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-8shrm to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-785dw to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86 to ip-10-0-136-103.us-west-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cba6f9af-openshift-default-db985b657-24dg4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-4h2lv

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-4h2lv to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2 to ip-10-0-139-247.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-2fdsg to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d51175-openshift-default-647d58c97-r497w to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q to ip-10-0-135-235.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-w5vkv to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99 to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4 to ip-10-0-136-103.us-west-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-rkx8l to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf to ip-10-0-139-247.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4 to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk to ip-10-0-136-103.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9 to ip-10-0-135-235.us-west-2.compute.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-d5df879b9 from 0 to 1

openshift-ingress

replicaset-controller

router-default-d5df879b9

SuccessfulCreate

Created pod: router-default-d5df879b9-lxqd6
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

Created

Container created

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-d5df879b9-lxqd6

Started

Container started

openshift-ingress

multus

router-default-d5df879b9-lxqd6

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-zhc8j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-zhc8j

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.362s (4.362s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Created

Container created

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-64dd656c99

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-64dd656c99 from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-tskjl

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-tskjl

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.58s (4.58s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64dd656c99-ns25f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.561s (4.561s including waiting). Image size: 183555333 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1
(x7)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-5zfvl

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-5zfvl

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5zfvl

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-jph7z

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-jph7z

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jph7z

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jph7z

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jph7z

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jph7z

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.8s (2.8s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5zfvl

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.842s (3.842s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5zfvl

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5zfvl

Started

Container started

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-b679c64f6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-b679c64f6-m25l7

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-b679c64f6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-b679c64f6-l58kw

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-b679c64f6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-b679c64f6-sscc5

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-b679c64f6 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-b679c64f6-m25l7

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-b679c64f6-l58kw

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-b679c64f6-sscc5

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found
(x12)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.865s (3.865s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.408s (3.408s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.452s (3.452s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 908ms (908ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 793ms (793ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-l58kw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-sscc5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 934ms (934ms including waiting). Image size: 273709574 bytes.
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

opendatahub-operator-controller-manager-b679c64f6-sscc5_e34427db-0d62-4145-8c43-9ce1e817b206

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-b679c64f6-sscc5_e34427db-0d62-4145-8c43-9ce1e817b206 became leader
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-qhzt7

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-hqt9s

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-hqt9s

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-hqt9s

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-clxzt

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-hqt9s

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.79s (3.79s including waiting). Image size: 190804149 bytes.

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-x7d9h

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-hqt9s

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-hqt9s

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-clxzt

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-597b95cb84-clxzt

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

dns-operator-controller-manager-8557cbdb84-hqt9s_64ddf26d-0554-469d-b860-4464ffac7c65

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-hqt9s_64ddf26d-0554-469d-b860-4464ffac7c65 became leader

cert-manager

multus

cert-manager-597b95cb84-clxzt

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-clxzt

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-x7d9h

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

authorino-operator-7b7bb4bc77-x7d9h

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-x7d9h

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-x7d9h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.897s (2.897s including waiting). Image size: 167738465 bytes.

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-2n2lb

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-x7d9h

Created

Container created

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-45sf7

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-45sf7
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Created

Container created

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-2n2lb

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-b679c64f6-m25l7

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 831ms (831ms including waiting). Image size: 273709574 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-2n2lb

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-45sf7

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-2n2lb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.019s (3.019s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-2n2lb

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-2n2lb

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-45sf7

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.016s (3.017s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-45sf7

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

limitador-operator-controller-manager-5778bb4449-2n2lb_c831fa19-71ef-4bb9-b98f-88fdd87d7f9d

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-2n2lb_c831fa19-71ef-4bb9-b98f-88fdd87d7f9d became leader

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-45sf7

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-45sf7_cbacbcae-3291-43ac-a39e-9033c8638687 became leader

kuadrant-system

authorino-operator-7b7bb4bc77-x7d9h_5f8b18cc-19e8-4afa-8f6a-be06f8594f8e

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-x7d9h_5f8b18cc-19e8-4afa-8f6a-be06f8594f8e became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-2nmjm

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-2nmjm

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-2nmjm

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-2nmjm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 10.818s (10.818s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-2nmjm

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-2nmjm

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-2nmjm_717818d4-f2d1-4191-a8ce-49892d333aeb

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-2nmjm_717818d4-f2d1-4191-a8ce-49892d333aeb became leader

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-lwl75

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-lwl75

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-lwl75

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-lwl75

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.865s (5.865s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-lwl75

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-lwl75

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-mx9lt"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-r27t5"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7ddcd68ff8 from 0 to 2

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

replicaset-controller

kube-auth-proxy-7ddcd68ff8

SuccessfulCreate

Created pod: kube-auth-proxy-7ddcd68ff8-ckxc2

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-649697ffd5 from 0 to 1

openshift-ingress

multus

kube-auth-proxy-7ddcd68ff8-rjfdr

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

replicaset-controller

kube-auth-proxy-7ddcd68ff8

SuccessfulCreate

Created pod: kube-auth-proxy-7ddcd68ff8-rjfdr

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-649697ffd5

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-7ddcd68ff8-ckxc2

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

Started

Container started

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-649697ffd5vd6w4

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-2hmg8

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-5866c976c5 from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-2hmg8

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2hmg8

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-5866c976c5

SuccessfulCreate

Created pod: jobset-controller-manager-5866c976c5-ksz8q

openshift-jobset-operator

kubelet

jobset-controller-manager-5866c976c5-ksz8q

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-ckxc2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.337s (3.337s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-zpdbb

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-5866c976c5-ksz8q

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7ddcd68ff8-rjfdr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.34s (3.34s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-57f7f8659f-zpdbb

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-zpdbb

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-nj5xz

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-hfpsb

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-57f7f8659f-zpdbb

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-zpdbb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.87s (2.87s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-hfpsb

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-zpdbb

Started

Container started

kuadrant-system

multus

authorino-56c6c9ddd5-nj5xz

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-hfpsb

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2hmg8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 4.291s (4.291s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2hmg8

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2hmg8

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nj5xz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-jobset-operator

kubelet

jobset-controller-manager-5866c976c5-ksz8q

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-5866c976c5-ksz8q

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.352s (4.352s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-5866c976c5-ksz8q

Started

Container started

openshift-jobset-operator

jobset-controller-manager-5866c976c5-ksz8q_42330133-0429-4cc0-b887-3781988659d2

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-5866c976c5-ksz8q_42330133-0429-4cc0-b887-3781988659d2 became leader

kuadrant-system

kubelet

authorino-56c6c9ddd5-nj5xz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.497s (2.497s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-nj5xz

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nj5xz

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-hfpsb

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-hfpsb

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-hfpsb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.014s (2.014s including waiting). Image size: 133379307 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-zpdbb

kuadrant-system

kubelet

authorino-57f7f8659f-zpdbb

Killing

Stopping container authorino

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-ndgmq

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ndgmq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-ndgmq

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ndgmq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.336s (2.336s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ndgmq

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ndgmq

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-2hmg8

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2hmg8

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-ndgmq_c23a10b9-d23f-4681-be7b-f2a2cfd005c8

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-ndgmq_c23a10b9-d23f-4681-be7b-f2a2cfd005c8 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

maas-controller-75695549d4

SuccessfulCreate

Created pod: maas-controller-75695549d4-cp6tv

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-75695549d4 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7bb9976d7 from 0 to 1

opendatahub

multus

maas-controller-7bb9976d7-w6btv

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

multus

maas-controller-75695549d4-cp6tv

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-75695549d4-cp6tv

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:13aa7ef402172bd132e35bf9fe524ee3f4a0a9dd1b2b93f1f24aecb262dde192"

opendatahub

kubelet

maas-controller-7bb9976d7-w6btv

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:13aa7ef402172bd132e35bf9fe524ee3f4a0a9dd1b2b93f1f24aecb262dde192"

opendatahub

replicaset-controller

maas-controller-7bb9976d7

SuccessfulCreate

Created pod: maas-controller-7bb9976d7-w6btv

opendatahub

kubelet

maas-controller-7bb9976d7-w6btv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:13aa7ef402172bd132e35bf9fe524ee3f4a0a9dd1b2b93f1f24aecb262dde192" in 5.651s (5.651s including waiting). Image size: 200099535 bytes.

opendatahub

kubelet

maas-controller-7bb9976d7-w6btv

Created

Container created

opendatahub

kubelet

maas-controller-7bb9976d7-w6btv

Started

Container started

opendatahub

kubelet

maas-controller-75695549d4-cp6tv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:13aa7ef402172bd132e35bf9fe524ee3f4a0a9dd1b2b93f1f24aecb262dde192" in 6.218s (6.218s including waiting). Image size: 200099535 bytes.

opendatahub

kubelet

maas-controller-75695549d4-cp6tv

Created

Container created

opendatahub

kubelet

maas-controller-75695549d4-cp6tv

Started

Container started

opendatahub

maas-controller-7bb9976d7-w6btv_a4c50f20-70b3-4903-af70-bf32512615d3

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7bb9976d7-w6btv_a4c50f20-70b3-4903-af70-bf32512615d3 became leader

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-hkbfq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hkbfq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-zhc8j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

ProbeError

Readiness probe error: Get "http://10.134.0.17:8080/ready": dial tcp 10.134.0.17:8080: connect: connection refused body:

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zhc8j

Unhealthy

Readiness probe failed: Get "http://10.134.0.17:8080/ready": dial tcp 10.134.0.17:8080: connect: connection refused

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-fbqk9

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-kwv2h

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-ccqh4

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-64xrk

opendatahub

kubelet

odh-model-controller-769875db56-ccqh4

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kwv2h

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

odh-model-controller-769875db56-ccqh4

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-64xrk

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-kwv2h

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-fbqk9

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

model-serving-api-75bd89fdfc-fbqk9

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-64xrk

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

maas-controller-75695549d4-cp6tv

Killing

Stopping container manager

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-64xrk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.527s (2.527s including waiting). Image size: 235100981 bytes.

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-75695549d4 from 1 to 0

opendatahub

replicaset-controller

maas-controller-75695549d4

SuccessfulDelete

Deleted pod: maas-controller-75695549d4-cp6tv

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kwv2h

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.98s (2.98s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-fbqk9

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-64xrk

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kwv2h

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-64xrk

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-fbqk9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.515s (2.515s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-fbqk9

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kwv2h

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-kwv2h_c3e61115-c857-45e3-aba8-2dde0cb298e8

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-kwv2h_c3e61115-c857-45e3-aba8-2dde0cb298e8 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-64xrk_8b6cd484-1473-4847-8421-c065a6fa56a2

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-64xrk_8b6cd484-1473-4847-8421-c065a6fa56a2 became leader

opendatahub

kubelet

odh-model-controller-769875db56-ccqh4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.622s (4.622s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-ccqh4

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-ccqh4

Created

Container created

opendatahub

odh-model-controller-769875db56-ccqh4_d317fdac-b4e6-43d3-b7c9-f8e5dbe3338b

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-ccqh4_d317fdac-b4e6-43d3-b7c9-f8e5dbe3338b became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-dxvdj

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.12s (14.12s including waiting). Image size: 1089502687 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-jvrbq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-5b7b9b54fb

SuccessfulCreate

Created pod: authorino-5b7b9b54fb-2b5qg

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-5b7b9b54fb from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-jvrbq

kuadrant-system

replicaset-controller

authorino-dc679f98

SuccessfulCreate

Created pod: authorino-dc679f98-zqbjw

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-5b7b9b54fb from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-dc679f98 from 0 to 1

kuadrant-system

multus

authorino-5b7b9b54fb-2b5qg

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-5b7b9b54fb

SuccessfulDelete

Deleted pod: authorino-5b7b9b54fb-2b5qg

kuadrant-system

kubelet

authorino-5b7b9b54fb-2b5qg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-dc679f98-zqbjw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-dc679f98-zqbjw

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5b7b9b54fb-2b5qg

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Created

Container created

kuadrant-system

kubelet

authorino-dc679f98-zqbjw

Started

Container started

kuadrant-system

kubelet

authorino-dc679f98-zqbjw

Created

Container created

kuadrant-system

kubelet

authorino-5b7b9b54fb-2b5qg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.746s (1.746s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5b7b9b54fb-2b5qg

Started

Container started

kuadrant-system

kubelet

authorino-dc679f98-zqbjw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.484s (1.484s including waiting). Image size: 204096810 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Started

Container started

kuadrant-system

kubelet

authorino-5b7b9b54fb-2b5qg

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-nj5xz

kuadrant-system

kubelet

authorino-56c6c9ddd5-nj5xz

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-tskjl

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-t4whx

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-t4whx

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-t4whx

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-t4whx

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-t4whx

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-t4whx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 798ms (798ms including waiting). Image size: 235100981 bytes.

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-64xrk

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-64xrk

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

multus

ai-gateway-controller-7d85675f98-2kkhq

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-2kkhq

opendatahub

kubelet

ai-gateway-controller-7d85675f98-2kkhq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-2kkhq

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-2kkhq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.117s (3.117s including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-2kkhq

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-2kkhq_963915e5-824f-45ba-921a-4963912dd8fa

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-2kkhq_963915e5-824f-45ba-921a-4963912dd8fa became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-4h2lv

openshift-ingress

multus

payload-pre-processing-7b98bb678c-j82zb

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-j82zb

openshift-ingress

multus

payload-processing-55fbbbf9dc-4h2lv

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.16s (3.16s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.118s (3.118s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4h2lv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j82zb

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-t4whx_35f50962-6c68-4ffb-b6e1-990bf4882c23

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-t4whx_35f50962-6c68-4ffb-b6e1-990bf4882c23 became leader

opendatahub

replicaset-controller

ai-gateway-controller-c9959c9bb

SuccessfulCreate

Created pod: ai-gateway-controller-c9959c9bb-l695c

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-c9959c9bb from 0 to 1

opendatahub

multus

ai-gateway-controller-c9959c9bb-l695c

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-c9959c9bb-l695c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-c9959c9bb-l695c

Started

Container started

opendatahub

kubelet

ai-gateway-controller-c9959c9bb-l695c

Created

Container created

opendatahub

kubelet

ai-gateway-controller-c9959c9bb-l695c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 864ms (864ms including waiting). Image size: 183979434 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-2kkhq

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-2kkhq

Killing

Stopping container manager

opendatahub

ai-gateway-controller-c9959c9bb-l695c_5a322421-d6be-439f-af0f-df8200edd85f

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-c9959c9bb-l695c_5a322421-d6be-439f-af0f-df8200edd85f became leader

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.01s (2.01s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-zwwbc

Started

Container started

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.605s (1.605s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2fdsg

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 684ms (684ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-w5vkv

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-rkx8l

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 582ms (582ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 622ms (622ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pb27h

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-lhp52

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lhp52

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-lhp52

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lhp52

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.522s (2.522s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lhp52

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lhp52

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-j9zww

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 530ms (530ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 686ms (686ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 1 to 2

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-skrdd
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-skrdd

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.33s (4.33s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-95j59

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-95rfd

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-95j59

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-95rfd

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.827s (3.827s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-69dbd95c57

SuccessfulCreate

Created pod: authorino-69dbd95c57-6q7xh
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

kuadrant-system

kubelet

authorino-69dbd95c57-6q7xh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-69dbd95c57-6q7xh

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-dc679f98-zqbjw

Killing

Stopping container authorino
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-dc679f98 from 1 to 0

kuadrant-system

kubelet

authorino-69dbd95c57-6q7xh

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

kuadrant-system

kubelet

authorino-69dbd95c57-6q7xh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.654s (1.654s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-69dbd95c57-6q7xh

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-8t2kn

kuadrant-system

replicaset-controller

authorino-dc679f98

SuccessfulDelete

Deleted pod: authorino-dc679f98-zqbjw

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 4 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-8t2kn

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-09e3828d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-09e3828d

openshift-ingress

deployment-controller

e2e-ait-2b62c067-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2b62c067-openshift-default-f85b48b9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2b62c067-openshift-default-f85b48b9c

SuccessfulCreate

Created pod: e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

openshift-ingress

gateway_labeler_controller

e2e-ait-2b62c067

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2b62c067

openshift-ingress

gateway_labeler_controller

e2e-migrate-53cc8e62-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-53cc8e62-gw

openshift-ingress

deployment-controller

e2e-migrate-53cc8e62-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65

SuccessfulCreate

Created pod: e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

openshift-ingress

deployment-controller

e2e-ait-09e3828d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-09e3828d-openshift-default-54b654cff9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-09e3828d-openshift-default-54b654cff9

SuccessfulCreate

Created pod: e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

openshift-ingress

multus

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2b62c067

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2b62c067-8ddd9b947 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b62c067-8ddd9b947

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2b62c067-8ddd9b947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b62c067: serviceaccount "payload-processing-e2e-ait-2b62c067" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b62c067-8ddd9b947

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b62c067: serviceaccount "payload-processing-e2e-ait-2b62c067" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2b62c067

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-d0628e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-d0628e

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-16457c0e-openshift-default-68984cb5df

SuccessfulCreate

Created pod: e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

openshift-ingress

gateway_labeler_controller

e2e-ait-2e734c1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2e734c1c

openshift-ingress

deployment-controller

e2e-ait-2e734c1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2e734c1c-openshift-default-64c45c6cd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2e734c1c-openshift-default-64c45c6cd9

SuccessfulCreate

Created pod: e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

openshift-ingress

gateway_labeler_controller

e2e-derive-16457c0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-16457c0e

openshift-ingress

deployment-controller

e2e-derive-16457c0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-16457c0e-openshift-default-68984cb5df from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-09e3828d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-09e3828d-648d8764c7 from 0 to 1

openshift-ingress

multus

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-09e3828d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-e6ca80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-e6ca80

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-09e3828d: serviceaccount "payload-processing-e2e-ait-09e3828d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-09e3828d-648d8764c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-09e3828d-648d8764c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-09e3828d-648d8764c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-09e3828d: serviceaccount "payload-processing-e2e-ait-09e3828d" not found

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-53cc8e62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-53cc8e62-74b7cc9b55 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-53cc8e62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-53cc8e62: serviceaccount "payload-processing-e2e-migrate-53cc8e62" not found

openshift-ingress

multus

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-53cc8e62: serviceaccount "payload-processing-e2e-migrate-53cc8e62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

openshift-ingress

multus

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.133s (3.134s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-d0628e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-d0628e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-d0628e: serviceaccount "payload-processing-e2e-worker-w1-d0628e" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-d0628e: serviceaccount "payload-processing-e2e-worker-w1-d0628e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2e734c1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2e734c1c-7546bf48b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2e734c1c: serviceaccount "payload-processing-e2e-ait-2e734c1c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2e734c1c-7546bf48b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2e734c1c-7546bf48b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2e734c1c-7546bf48b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2e734c1c: serviceaccount "payload-processing-e2e-ait-2e734c1c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2e734c1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-derive-16457c0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-16457c0e-6f9bf4dfb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-16457c0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-16457c0e: serviceaccount "payload-processing-e2e-derive-16457c0e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-16457c0e: serviceaccount "payload-processing-e2e-derive-16457c0e" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Started

Container started

openshift-ingress

multus

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Created

Container created

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-e6ca80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-e6ca80-699dc489fc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e6ca80-699dc489fc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-e6ca80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e6ca80: serviceaccount "payload-processing-e2e-worker-w0-e6ca80" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-e6ca80-699dc489fc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-e6ca80-699dc489fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-e6ca80: serviceaccount "payload-processing-e2e-worker-w0-e6ca80" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.647s (2.647s including waiting). Image size: 125353963 bytes.
(x5)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:45742->10.132.0.59:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:45742->10.132.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09e3828d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2b62c067-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-09e3828d-648d8764c7-2smh8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09e3828d-7d6cc9fd47-fvkw5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-09e3828d-openshift-default-54b654cff9-79hnh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-10d2fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-10d2fb

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-2b62c067-8ddd9b947-wk89c

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-53cc8e62-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b62c067-d45b7f8cf-mfhwz

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-53cc8e62-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-migrate-53cc8e62-74b7cc9b55-w4cnb

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-53cc8e62-8498c6ddc5-jhlwb

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-10d2fb-6bd458c589

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-10d2fb-6bd458c589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-10d2fb: serviceaccount "payload-processing-e2e-worker-w2-10d2fb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-10d2fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-10d2fb-6bd458c589 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-10d2fb: serviceaccount "payload-processing-e2e-worker-w2-10d2fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-10d2fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-10d2fb-6bd458c589

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

openshift-ingress

kubelet

e2e-migrate-53cc8e62-gw-openshift-default-56f87b5c65-clzsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 0 to 1

openshift-ingress

multus

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulCreate

Created pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

openshift-ingress

gateway_labeler_controller

e2e-worker-w5-9d77b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-9d77b6

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-2b62c067-openshift-default-f85b48b9c-pb4vm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-16457c0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2e734c1c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-16457c0e-6f9bf4dfb9-6sr7p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-16457c0e-d4c6c5d59-6hzt2

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w5-9d77b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w5-9d77b6-869d7d4b59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w5-9d77b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-9d77b6: serviceaccount "payload-processing-e2e-worker-w5-9d77b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-9d77b6: serviceaccount "payload-processing-e2e-worker-w5-9d77b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-108cf9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-108cf9

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Started

Container started

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-2e734c1c-7546bf48b7-fs62d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2e734c1c-57f65d68bc-wl6ms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 0 to 1

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-16457c0e-openshift-default-68984cb5df-gj9s2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

openshift-ingress

gateway_labeler_controller

e2e-worker-w6-096685

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-096685
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-108cf9: serviceaccount "payload-processing-e2e-worker-w3-108cf9" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-108cf9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-108cf9-7c4649d4cf from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-108cf9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-108cf9: serviceaccount "payload-processing-e2e-worker-w3-108cf9" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w6-096685

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w6-096685-68c968b4c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w6-096685

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w6-096685-7b87f87d87 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-096685: serviceaccount "payload-processing-e2e-worker-w6-096685" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

openshift-ingress

multus

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w6-096685-68c968b4c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w6-096685-68c968b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-096685: serviceaccount "payload-processing-e2e-worker-w6-096685" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w6-096685-68c968b4c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:40728->10.134.0.37:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:40728->10.134.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Created

Container created

openshift-ingress

kubelet

e2e-ait-2e734c1c-openshift-default-64c45c6cd9-rhsjg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-8e6407

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-8e6407

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 0 to 1

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-8e6407

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8e6407: serviceaccount "payload-processing-e2e-worker-w4-8e6407" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-8e6407

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8e6407: serviceaccount "payload-processing-e2e-worker-w4-8e6407" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Started

Container started

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-skrdd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-skrdd

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 5 to 4

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 2 to 3

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 2 to 3

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Created

Container created

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 1 to 2

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Started

Container started

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Started

Container started

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-95j59

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95j59

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 4 to 3

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulCreate

Created pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

openshift-ingress

multus

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-95rfd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-95rfd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Started

Container started

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulCreate

Created pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-8t2kn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-8t2kn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Created

Container created

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

openshift-ingress

gateway_labeler_controller

e2e-mt-cba6f9af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cba6f9af

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cba6f9af-767f954cd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cba6f9af-767f954cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulCreate

Created pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulCreate

Created pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Created

Container created

openshift-ingress

multus

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-f5bb4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f5bb4f

openshift-ingress

deployment-controller

e2e-api-a-f5bb4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f5bb4f-openshift-default-5f5c77b87 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-f5bb4f-openshift-default-5f5c77b87

SuccessfulCreate

Created pod: e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

openshift-ingress

multus

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-l54fd

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-fkv8m

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 1 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-l54fd

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-fkv8m

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-b26f03-openshift-default-7d5d7795c5

SuccessfulCreate

Created pod: e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

openshift-ingress

deployment-controller

e2e-api-a-b26f03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b26f03-openshift-default-7d5d7795c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b26f03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b26f03

openshift-ingress

multus

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f5bb4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f5bb4f-697d79c597 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f5bb4f-697d79c597

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f5bb4f-697d79c597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f5bb4f: serviceaccount "payload-processing-e2e-api-a-f5bb4f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f5bb4f-697d79c597

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f5bb4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f5bb4f: serviceaccount "payload-processing-e2e-api-a-f5bb4f" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Started

Container started

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 5 to 7

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b26f03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b26f03-97b5f4d87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b26f03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b26f03-5cc97cdb97 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b26f03: serviceaccount "payload-processing-e2e-api-a-b26f03" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b26f03-5cc97cdb97

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b26f03-5cc97cdb97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b26f03: serviceaccount "payload-processing-e2e-api-a-b26f03" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b26f03-5cc97cdb97

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulCreate

Created pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Created

Container created

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Created

Container created

openshift-ingress

multus

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulCreate

Created pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

ProbeError

Readiness probe error: Get "http://10.132.0.113:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Unhealthy

Readiness probe failed: Get "http://10.132.0.113:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 3 to 5
(x2)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d
(x2)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulCreate

Created pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-00cc0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-00cc0e-openshift-default-748c64f44c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-00cc0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-00cc0e

openshift-ingress

replicaset-controller

e2e-api-a-00cc0e-openshift-default-748c64f44c

SuccessfulCreate

Created pod: e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulCreate

Created pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Unhealthy

Readiness probe failed: Get "https://10.132.0.54:8000/ready": context deadline exceeded
(x6)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-19ee94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-19ee94

openshift-ingress

multus

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-19ee94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7 from 0 to 1

openshift-ingress

multus

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7

SuccessfulCreate

Created pod: e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr
(x7)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x9)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-bca68b-openshift-default-5b84bcc475

SuccessfulCreate

Created pod: e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj
(x9)

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bca68b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bca68b

openshift-ingress

deployment-controller

e2e-ipp-a-bca68b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bca68b-openshift-default-5b84bcc475 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-a25202-openshift-default-745bcccd99

SuccessfulCreate

Created pod: e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

openshift-ingress

deployment-controller

e2e-api-b-a25202-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a25202-openshift-default-745bcccd99 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a25202

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a25202

openshift-ingress

multus

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-00cc0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-00cc0e-649cc67649 from 0 to 1
(x8)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-00cc0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-00cc0e-649cc67649

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-00cc0e: serviceaccount "payload-processing-e2e-api-a-00cc0e" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-00cc0e-649cc67649

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-00cc0e-649cc67649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-00cc0e: serviceaccount "payload-processing-e2e-api-a-00cc0e" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bca68b-5948b5c78f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-5948b5c78f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-5948b5c78f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bca68b-5948b5c78f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a25202-7f74f7945

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a25202-7f74f7945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a25202: serviceaccount "payload-processing-e2e-api-b-a25202" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a25202

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a25202-7f74f7945 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a25202

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a25202-8c9b8c975 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a25202-8c9b8c975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a25202-8c9b8c975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a25202: serviceaccount "payload-processing-e2e-api-b-a25202" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a25202-7f74f7945

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a25202-8c9b8c975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulDelete

Deleted pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 4 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulDelete

Deleted pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-nd5dp

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f5bb4f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f

SuccessfulCreate

Created pod: e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

openshift-ingress

deployment-controller

e2e-api-b-c7f7d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-c7f7d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c7f7d7

openshift-ingress

multus

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-19ee94-5b695cbd99 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5b695cbd99

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-19ee94-5b695cbd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-9vbxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5b695cbd99

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-5p6pr

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b26f03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 7.128s (7.128s including waiting). Image size: 185476477 bytes.

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-t7927

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c7f7d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c7f7d7: serviceaccount "payload-processing-e2e-api-b-c7f7d7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c7f7d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c7f7d7-6cdd9b9465 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c7f7d7: serviceaccount "payload-processing-e2e-api-b-c7f7d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-69a9bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-69a9bb

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69a9bb-56d6547467 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-56d6547467

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-56d6547467

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69a9bb-56d6547467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-7355-c9b19c

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7355-c9b19c

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7355-c9b19c

Started

Container started

opendatahub

kubelet

test-curl-7355-c9b19c

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.949s (2.949s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7355-c9b19c

Created

Container created

opendatahub

kubelet

test-curl-7355-c9b19c

Killing

Stopping container test-curl-7355-c9b19c

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-00cc0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bca68b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

openshift-ingress

gateway_labeler_controller

e2e-api-b-b9eea3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b9eea3

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Unhealthy

Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

ProbeError

Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-api-b-b9eea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9eea3-openshift-default-557d9d8589 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Created

Container created

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-6ltlg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-6m42b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-5948b5c78f-9dnzc

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-5b56fcb9bc-s9hsb

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b9eea3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b9eea3-786cd56d67 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b9eea3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b9eea3-f4ff45995 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9eea3: serviceaccount "payload-processing-e2e-api-b-b9eea3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b9eea3-f4ff45995

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b9eea3-f4ff45995

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b9eea3-f4ff45995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9eea3: serviceaccount "payload-processing-e2e-api-b-b9eea3" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulDelete

Deleted pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-lt5cv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a25202-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulDelete

Deleted pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-7cpkm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c17125

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c17125

openshift-ingress

replicaset-controller

e2e-ipp-b-c17125-openshift-default-58cf794799

SuccessfulCreate

Created pod: e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

openshift-ingress

deployment-controller

e2e-ipp-b-c17125-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c17125-openshift-default-58cf794799 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c17125

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c17125-c9cfb7b45 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c17125: serviceaccount "payload-processing-e2e-ipp-b-c17125" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c7f7d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c17125

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c17125-c9cfb7b45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c17125-c9cfb7b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c17125: serviceaccount "payload-processing-e2e-ipp-b-c17125" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c17125-c9cfb7b45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f5bb4f-697d79c597-jx6th

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f5bb4f-76dd5cc59f-gzrmn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-bd58c7955-fgfvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5b695cbd99-jmxjn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-b6a289-openshift-default-5cfd69676f

SuccessfulCreate

Created pod: e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

openshift-ingress

deployment-controller

e2e-ipp-b-b6a289-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b6a289-openshift-default-5cfd69676f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b6a289

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b6a289

openshift-ingress

multus

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-19ee94-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 1 to 4

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Created

Container created

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b6a289

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b6a289-59d8578bc5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6a289-59d8578bc5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b6a289-59d8578bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6a289: serviceaccount "payload-processing-e2e-ipp-b-b6a289" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b6a289

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6a289: serviceaccount "payload-processing-e2e-ipp-b-b6a289" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6a289-59d8578bc5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

openshift-ingress

multus

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-fkv8m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-fkv8m

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-b26f03-5cc97cdb97-dq8b4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b26f03-97b5f4d87-x84v9

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bca68b-576d767654 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-576d767654

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bca68b-576d767654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bca68b: serviceaccount "payload-processing-e2e-ipp-a-bca68b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bca68b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bca68b-576d767654

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.922s (1.922s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.41s (2.41s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Created

Container created

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 4 to 8

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulCreate

Created pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

openshift-ingress

multus

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 8 to 9

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-2txrx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-qj7ll

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 8 to 6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-19ee94-5bbd659cfb from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-19ee94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ee94: serviceaccount "payload-processing-e2e-ipp-a-19ee94" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4vhlf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 10 to 7

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-phrb8

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-cbfzg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-6b478dd6bc-crlhl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-56d6547467-tltlc

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-nkchd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 7 to 6

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-pmmbv

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cba6f9af-767f954cd7 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cba6f9af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cba6f9af-767f954cd7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cba6f9af-767f954cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cba6f9af: serviceaccount "payload-processing-e2e-mt-cba6f9af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-f5bb4f-openshift-default-5f5c77b87-h4b9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulDelete

Deleted pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a25202-8c9b8c975-6dh52

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a25202-7f74f7945-bp6zb

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 5 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-tkmcr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-27dpb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-rrwpt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-bb97d

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulDelete

Deleted pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-108cf9-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-108cf9-openshift-default-7b9d95789

SuccessfulDelete

Deleted pod: e2e-worker-w3-108cf9-openshift-default-7b9d95789-phwrw

openshift-ingress

deployment-controller

e2e-worker-w3-108cf9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-108cf9-openshift-default-7b9d95789 from 4 to 2

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-kbmp6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 6 to 5

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

ProbeError

Readiness probe error: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Unhealthy

Readiness probe failed: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c17125-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69a9bb-749666bffb from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69a9bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Created

Container created
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-749666bffb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69a9bb-749666bffb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a9bb: serviceaccount "payload-processing-e2e-ipp-a-69a9bb" not found

openshift-ingress

deployment-controller

e2e-api-b-b9eea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9eea3-openshift-default-557d9d8589 from 1 to 4

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Created

Container created

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a9bb-749666bffb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-h8mqt

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-a-00cc0e-649cc67649-s6tnf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-00cc0e-5cccb954ff-vkxz9

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-glz4k

Unhealthy

Readiness probe failed: Get "https://10.132.0.54:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-45fc31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-45fc31

openshift-ingress

deployment-controller

e2e-ipp-b-45fc31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-45fc31-openshift-default-9658b4cf7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-45fc31-openshift-default-9658b4cf7

SuccessfulCreate

Created pod: e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

openshift-ingress

multus

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-7d5c46c999

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-45fc31-7d5c46c999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-7d5c46c999

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-45fc31-7d5c46c999 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Created

Container created

openshift-ingress

kubelet

e2e-api-a-b26f03-openshift-default-7d5d7795c5-2f874

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6a289-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-b9eea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9eea3-openshift-default-557d9d8589 from 4 to 6

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

openshift-ingress

replicaset-controller

e2e-api-b-b9eea3-openshift-default-557d9d8589

SuccessfulCreate

Created pod: e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b9eea3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Created

Container created

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Started

Container started

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Created

Container created

openshift-ingress

multus

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-c7f7d7-6cdd9b9465-5j2qj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c7f7d7-67b6db8f55-s5znn

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bca68b-dbd9bf47f-tk698

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bca68b-576d767654-9b22q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-bca68b-openshift-default-5b84bcc475-dckvj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ee94-5bbd659cfb-kmhsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-a25202-openshift-default-745bcccd99-d7c9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c17125-c9cfb7b45-fzdvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c17125-79ccd5bfbc-k745t

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d51175

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d51175

openshift-ingress

deployment-controller

e2e-ipp-a-d51175-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d51175-openshift-default-647d58c97 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ee94-5bd65f9b4c-2vz6n

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-d51175-openshift-default-647d58c97

SuccessfulCreate

Created pod: e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

openshift-ingress

multus

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-19ee94-openshift-default-78dc4bb6f7-rsvpr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d51175-77c9b96c4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-77c9b96c4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-77c9b96c4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d51175-77c9b96c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d51175-7cb67799f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6a289-59d8578bc5-9t769

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6a289-7f9866786c-m9lpk

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-pz258

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7355-6b4e7e

Created

Container created

opendatahub

multus

test-curl-7355-6b4e7e

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7355-6b4e7e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7355-6b4e7e

Started

Container started

opendatahub

kubelet

test-curl-7355-6b4e7e

Killing

Stopping container test-curl-7355-6b4e7e
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

ProbeError

Startup probe error: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Unhealthy

Startup probe failed: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f4516e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f4516e

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-a-f4516e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f4516e-openshift-default-7b5569dcd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9

SuccessfulCreate

Created pod: e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

openshift-ingress

kubelet

e2e-ipp-b-c17125-openshift-default-58cf794799-q4xqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-785dw

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Started

Container started

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Started

Container started

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Started

Container started

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cba6f9af-7c67c7fc87-nnltc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cba6f9af-767f954cd7-7r62b

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5

SuccessfulDelete

Deleted pod: e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

openshift-ingress

deployment-controller

e2e-worker-w5-9d77b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w5-9d77b6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-f7kvn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-mt-cba6f9af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cba6f9af-openshift-default-db985b657 from 8 to 10

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cba6f9af-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

replicaset-controller

e2e-mt-cba6f9af-openshift-default-db985b657

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Started

Container started

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f4516e-56c46dd57

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f4516e-56c46dd57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f4516e: serviceaccount "payload-processing-e2e-praxis-a-f4516e" not found

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f4516e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f4516e-56c46dd57 from 0 to 1

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f4516e: serviceaccount "payload-processing-e2e-praxis-a-f4516e" not found

openshift-ingress

multus

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f4516e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Created

Container created

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f4516e-56c46dd57

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-a-00cc0e-openshift-default-748c64f44c-28sg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 9 to 8

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-g2c9z

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-45fc31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9eea3-f4ff45995-9jxch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9eea3-786cd56d67-8gb67

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-x5gwb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-7d5c46c999-9c87l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-67b6c6fc67-vkfxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-c7bj9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-c7f7d7-openshift-default-7fd48d8c5f-wvqhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-b6a289-openshift-default-5cfd69676f-ms5mm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-a-9ceb40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9ceb40-openshift-default-67b68b47cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc

SuccessfulCreate

Created pod: e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9ceb40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9ceb40

openshift-ingress

multus

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-108cf9-67b58c9b95-djx86

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-108cf9-7c4649d4cf-zmfxg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 8 to 5

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

Unhealthy

Readiness probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

Unhealthy

Readiness probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

Unhealthy

Readiness probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-4jxpz

ProbeError

Readiness probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-btqv4

ProbeError

Readiness probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-k2wlc

ProbeError

Readiness probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9ceb40-59dfcd476c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-4x95s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-ldhbf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-fvkzp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-kxfsr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-8jkmb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d51175-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-b9eea3-openshift-default-557d9d8589-f2np6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7

SuccessfulDelete

Deleted pod: e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a9bb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-ipp-a-69a9bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-ipp-a-69a9bb-openshift-default-54c485cdc7 from 5 to 4

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-vp4dw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-t7927

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-dwqwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-bn64g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-24dg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-785dw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-pz258

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-5lbq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-8shrm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-2fk7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-cba6f9af-openshift-default-db985b657-c9zp7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-7cb67799f-8zv8m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-77c9b96c4c-6mb99

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-45fc31-679598b5b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c

SuccessfulDelete

Deleted pod: e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-q4kck

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-e6ca80-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-e6ca80-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-e6ca80-openshift-default-6b7b96448c from 2 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-45fc31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-8e6407-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8e6407-openshift-default-5fcc88db7c from 3 to 2

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8e6407-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c

SuccessfulDelete

Deleted pod: e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-rltfn
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-679598b5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-45fc31-679598b5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-45fc31: serviceaccount "payload-processing-e2e-ipp-b-45fc31" not found

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-45fc31-679598b5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-kggwb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-9d77b6-869d7d4b59-9gcx2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-9d77b6-6b8d464f8c-chxn6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-4grfk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ad4580

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ad4580

openshift-ingress

multus

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-ad4580-openshift-default-5f89696b85

SuccessfulCreate

Created pod: e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

openshift-ingress

deployment-controller

e2e-praxis-b-ad4580-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ad4580-openshift-default-5f89696b85 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ad4580

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ad4580-c6756f6f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a9bb-dcd64c4d7-n5lsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a9bb-749666bffb-j8tgh

Killing

Stopping container payload-processing
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad4580: serviceaccount "payload-processing-e2e-praxis-b-ad4580" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ad4580

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad4580-c6756f6f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ad4580-c6756f6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad4580: serviceaccount "payload-processing-e2e-praxis-b-ad4580" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad4580-c6756f6f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4516e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4516e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-gx6br

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-zmg2t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-5vzg9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d51175-7f8f8f648 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-x8nhb

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d51175

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-mjrfr

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-x8nhb
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-769df7846c from 2 to 4

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-69a9bb-openshift-default-54c485cdc7-kkvwf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-mjrfr
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-7f8f8f648

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d51175-7f8f8f648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d51175: serviceaccount "payload-processing-e2e-ipp-a-d51175" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d51175-7f8f8f648

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mjrfr

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-kgvsk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-rs4mw

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-gb7jv

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-rs4mw

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-gb7jv

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-kgvsk

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-b-2d5a5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2d5a5a-openshift-default-68b79576d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9

SuccessfulCreate

Created pod: e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2d5a5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2d5a5a

openshift-ingress

multus

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w5-9d77b6-openshift-default-5c9c5679b5-gxfx6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-8dw77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-108cf9-openshift-default-7b9d95789-f6pss

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-h55xg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-mm2ds

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-769df7846c-rvn8p

openshift-ingress

deployment-controller

e2e-ipp-a-9ceb40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9ceb40-openshift-default-67b68b47cc from 1 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc

SuccessfulCreate

Created pod: e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-h55xg

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-rvn8p

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-769df7846c-mm2ds

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Created

Container created

openshift-ingress

multus

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-59dfcd476c-qzzh7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-85875869cf-srd4k

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-45fc31-54f46b5c4c-zt7bg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-45fc31-679598b5b-vw9xg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-45fc31-openshift-default-9658b4cf7-n6hv2

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9ceb40-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Unhealthy

Startup probe failed: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

ProbeError

Startup probe error: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9ceb40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7 from 0 to 1
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9ceb40: serviceaccount "payload-processing-e2e-ipp-a-9ceb40" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e6407-5cf6bb55f9-ndnh9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e6407-7d964dbddc-zmgkm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.41:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

ProbeError

Readiness probe error: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Unhealthy

Readiness probe failed: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad4580-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d91f6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d91f6f

openshift-ingress

deployment-controller

e2e-ipp-b-d91f6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d91f6f-openshift-default-5776c68949 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-d91f6f-openshift-default-5776c68949

SuccessfulCreate

Created pod: e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

openshift-ingress

multus

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d91f6f-b7bf7884c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

openshift-ingress

multus

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4516e-55c767bf75-v5lj5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4516e-56c46dd57-n8tg4

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d5a5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-76688ddcc9-kl52d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-7b76f7d7c9-prmn5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-f4516e-openshift-default-7b5569dcd9-hmgk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad4580-c6756f6f7-dqstv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad4580-7c4f7599f9-zf8kd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-7lrl5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8e6407-openshift-default-5fcc88db7c-vkmvt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-e6ca80-d8dc59779-b5trh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-e6ca80-699dc489fc-vpr2c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d5a5a-79df66d896 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d5a5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-79df66d896

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d5a5a-79df66d896-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d5a5a: serviceaccount "payload-processing-e2e-ipp-b-2d5a5a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d5a5a-79df66d896

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-qvwxw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-ad4580-openshift-default-5f89696b85-74djd

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d91f6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d91f6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-5p6pr

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

Unhealthy

Readiness probe failed: Get "http://10.132.0.138:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-5p6pr

ProbeError

Readiness probe error: Get "http://10.132.0.138:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-b7bf7884c-qt6qm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-65669556d7-7l7v4

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w6-096685-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w6-096685-openshift-default-6ff6cb7b8f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w6-096685-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f

SuccessfulDelete

Deleted pod: e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-rmwmc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-10d2fb-6bd458c589-cnsb8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-10d2fb-94b576b87-rjztx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-e6ca80-openshift-default-6b7b96448c-cp8qv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d91f6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d91f6f-7cff4575b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-7cff4575b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d91f6f-7cff4575b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d91f6f: serviceaccount "payload-processing-e2e-ipp-b-d91f6f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d91f6f-7cff4575b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95

SuccessfulDelete

Deleted pod: e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-lskwx

openshift-ingress

deployment-controller

e2e-worker-w2-10d2fb-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-10d2fb-openshift-default-7689cfdd95 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-10d2fb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-10d2fb-openshift-default-7689cfdd95-w5lq4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9ceb40-b4bb7d6cb-v7jht

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9ceb40-5dd8d5d8d7-4zp6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-8fqpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-9ceb40-openshift-default-67b68b47cc-89dmc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f

SuccessfulDelete

Deleted pod: e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-zz5zx
(x4)

openshift-ingress

deployment-controller

e2e-worker-w1-d0628e-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-d0628e-openshift-default-6c484c4c6f from 2 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-d0628e-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d51175-7f8f8f648-sq8sr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d51175-787c6bc64c-2dglf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d91f6f-587b87dc9-4hkw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d91f6f-7cff4575b-8mxjk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d91f6f-openshift-default-5776c68949-5rjv2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9

SuccessfulCreate

Created pod: e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

openshift-ingress

deployment-controller

e2e-praxis-a-8f1e34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-8f1e34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-8f1e34

openshift-ingress

multus

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8f1e34: serviceaccount "payload-processing-e2e-praxis-a-8f1e34" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-8f1e34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-8f1e34-6c697ddb45 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-8f1e34: serviceaccount "payload-processing-e2e-praxis-a-8f1e34" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-8f1e34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-d51175-openshift-default-647d58c97-r497w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

ProbeError

Startup probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Unhealthy

Startup probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-mm2ds

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-h55xg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-rvn8p
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rvn8p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-h55xg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-gb7jv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-mm2ds

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-x8nhb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-gb7jv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-x8nhb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-l54fd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-l54fd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-bbb1eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-bbb1eb

openshift-ingress

multus

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-bbb1eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-bbb1eb-openshift-default-6b6876488f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f

SuccessfulCreate

Created pod: e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bbb1eb: serviceaccount "payload-processing-e2e-praxis-b-bbb1eb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-bbb1eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bbb1eb: serviceaccount "payload-processing-e2e-praxis-b-bbb1eb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-bbb1eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-bbb1eb-9df7698b5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d5a5a-56f7675bc5-rxlvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d5a5a-79df66d896-68n8h

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-8f1e34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-2d5a5a-openshift-default-68b79576d9-m5f8q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w6-096685-68c968b4c-nczhk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w6-096685-7b87f87d87-pxxvk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bbb1eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bbb1eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-8f1e34-6c697ddb45-jn68g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w6-096685-openshift-default-6ff6cb7b8f-bnbjn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-8f1e34-599f9f8f95-7ztcp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-8f1e34-openshift-default-b8cf56fd9-lzgrs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bbb1eb-9df7698b5-fvnsb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bbb1eb-85c98c7c7f-f8gpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-bbb1eb-openshift-default-6b6876488f-lzlnm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-d0628e-6c8bcd7b79-td4gr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-d0628e-6f566bc799-h56sw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-d0628e-openshift-default-6c484c4c6f-jlgg8

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-kgvsk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-kgvsk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-769df7846c from 3 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-769df7846c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-769df7846c-rs4mw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-769df7846c-rs4mw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503