Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc to ip-10-0-133-52.us-east-2.compute.internal

ai-tenants

e2e-autores-933245

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-933245: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-57d281

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-57d281: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-24b244

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-24b244: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-29b57c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-29b57c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-aaea41

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-aaea41: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-e38ef4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-e38ef4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-5370bb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-5370bb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-6f810f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-6f810f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-9ea5d2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-9ea5d2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-bccce1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-bccce1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-e3c4a7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-e3c4a7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-4a127b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-4a127b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-c268d1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-c268d1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-a97e34

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-a97e34: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-2babaef6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-2babaef6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-d2dc0ad5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-d2dc0ad5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-638f19

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-638f19: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-7f0c86

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-7f0c86: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-9be196

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-9be196: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-8b6cd6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-8b6cd6: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr to ip-10-0-136-26.us-east-2.compute.internal

ai-tenants

e2e-shared-b-w4-036c69

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-036c69: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-main-1bfa0e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-main-1bfa0e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-3a6480

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-3a6480: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-a6873b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-a6873b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-e27ae7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-e27ae7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-9de2ac

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-9de2ac: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-0aa61b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-0aa61b: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-rfv55

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-rfv55 to ip-10-0-136-26.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-fxgzj

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-fxgzj to ip-10-0-136-26.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-vjdvl

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-vjdvl to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7 to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

test-curl-7426-831cf1

Scheduled

Successfully assigned opendatahub/test-curl-7426-831cf1 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r to ip-10-0-133-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-79ddbf8d54-gln7d

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-79ddbf8d54-gln7d to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

test-curl-7426-ee9a91

Scheduled

Successfully assigned opendatahub/test-curl-7426-ee9a91 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv to ip-10-0-133-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7854fcbcdd-m6rzs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7854fcbcdd-m6rzs to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-978cf677d-rwtqn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-978cf677d-rwtqn to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7f75799d9b-w7752

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7f75799d9b-w7752 to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

test-curl-7426-f8e37f

Scheduled

Successfully assigned opendatahub/test-curl-7426-f8e37f to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-wwqfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-wwqfh to ip-10-0-137-175.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9hj4l to ip-10-0-136-26.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-68f76b7b94-ghwhj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-68f76b7b94-ghwhj to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b to ip-10-0-133-52.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-689bcf9f9-kjj7f to ip-10-0-133-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5bcd7997-9gj26

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-9gj26 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq to ip-10-0-133-52.us-east-2.compute.internal

kuadrant-system

authorino-564698f58b-mv8bw

Scheduled

Successfully assigned kuadrant-system/authorino-564698f58b-mv8bw to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-noten-82e760-openshift-default-5f697579fc-579fp

Scheduled

Successfully assigned openshift-ingress/e2e-noten-82e760-openshift-default-5f697579fc-579fp to ip-10-0-136-26.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-qvfwp to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh to ip-10-0-133-52.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-qf7xf

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-qf7xf to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-91f1523a-899695877-8wlls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-91f1523a-899695877-8wlls to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-trh22

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-trh22 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k to ip-10-0-137-175.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-598fcbc94f-mgqwx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-598fcbc94f-mgqwx to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2 to ip-10-0-137-175.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-pkn6m

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-pkn6m to ip-10-0-137-175.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-vtpsz

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-vtpsz to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-w6g7x

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-w6g7x to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq to ip-10-0-137-175.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-x9p74

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-x9p74 to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

maas-controller-7f997f45fb-2rd9z

Scheduled

Successfully assigned opendatahub/maas-controller-7f997f45fb-2rd9z to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr to ip-10-0-136-26.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-csx4b

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-csx4b to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

Scheduled

Successfully assigned openshift-ingress/e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld to ip-10-0-133-52.us-east-2.compute.internal

kuadrant-system

authorino-6d8bc659cc-72rg2

Scheduled

Successfully assigned kuadrant-system/authorino-6d8bc659cc-72rg2 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl to ip-10-0-137-175.us-east-2.compute.internal

kuadrant-system

authorino-6dd76875b5-xj4fd

Scheduled

Successfully assigned kuadrant-system/authorino-6dd76875b5-xj4fd to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k to ip-10-0-137-175.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-msx7k

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-msx7k to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2babaef6-67968898fc-kvt29 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

maas-controller-7f997f45fb-9tqcn

Scheduled

Successfully assigned opendatahub/maas-controller-7f997f45fb-9tqcn to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8 to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

maas-controller-7f997f45fb-p4fgb

Scheduled

Successfully assigned opendatahub/maas-controller-7f997f45fb-p4fgb to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5 to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

ai-gateway-controller-f9d557c9-9x2z8

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-f9d557c9-9x2z8 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc to ip-10-0-136-26.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7c8545db6f-llqbv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7c8545db6f-llqbv to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp to ip-10-0-136-26.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-9hf26

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-9hf26 to ip-10-0-137-175.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-566dcd79c7-n9nvf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-566dcd79c7-n9nvf to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5 to ip-10-0-136-26.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-689bcf9f9-lvm4r to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6 to ip-10-0-137-175.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-689bcf9f9-nwc4n to ip-10-0-137-175.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5 to ip-10-0-137-175.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9 to ip-10-0-133-52.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-bl4xv

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-bl4xv to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2 to ip-10-0-136-26.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-5fx26

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-5fx26 to ip-10-0-137-175.us-east-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-rgmfq

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-rgmfq to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz to ip-10-0-133-52.us-east-2.compute.internal

ai-tenants

e2e-api-a-3de00d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-3de00d: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2 to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

maas-controller-7f9f878d4b-fwg8j

Scheduled

Successfully assigned opendatahub/maas-controller-7f9f878d4b-fwg8j to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h to ip-10-0-137-175.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-59thg

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-59thg to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-s4pct

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-s4pct to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-jbfsn

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-jbfsn to ip-10-0-136-26.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-dvwgc

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-dvwgc to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-cj2xb

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-cj2xb to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

test-curl-7417-4a3db9

Scheduled

Successfully assigned opendatahub/test-curl-7417-4a3db9 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-qzbgz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-qzbgz to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-p6vnd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-p6vnd to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw to ip-10-0-137-175.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sxxmt to ip-10-0-136-26.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-m6sln

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-m6sln to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-m6qv8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-m6qv8 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-ljtcq to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

test-curl-7417-63c56c

Scheduled

Successfully assigned opendatahub/test-curl-7417-63c56c to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

Scheduled

Successfully assigned openshift-ingress/e2e-autores-933245-openshift-default-8b8b4856c-nbw24 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jsxtq to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-jmn77

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jmn77 to ip-10-0-137-175.us-east-2.compute.internal

opendatahub

test-curl-7417-8514c7

Scheduled

Successfully assigned opendatahub/test-curl-7417-8514c7 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs to ip-10-0-133-52.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-jtc4h

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-jtc4h to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

test-curl-7417-a77bc6

Scheduled

Successfully assigned opendatahub/test-curl-7417-a77bc6 to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

test-curl-7417-d5327f

Scheduled

Successfully assigned opendatahub/test-curl-7417-d5327f to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v to ip-10-0-137-175.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-d88cdf6dc-hn82d

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d88cdf6dc-hn82d to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn to ip-10-0-136-26.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-v5k66

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-v5k66 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs to ip-10-0-133-52.us-east-2.compute.internal

opendatahub

test-curl-7426-341a04

Scheduled

Successfully assigned opendatahub/test-curl-7426-341a04 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

test-curl-7426-34b933

Scheduled

Successfully assigned opendatahub/test-curl-7426-34b933 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g to ip-10-0-137-175.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-rrr99

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-rrr99 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-fl2rn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fl2rn to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c6qrt to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-bnsdt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-bnsdt to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-989zh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-989zh to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-fd4b99879-8v5dc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8v5dc to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-57d281-55d489b495-lvrd9 to ip-10-0-136-26.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-94gsr

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-94gsr to ip-10-0-137-175.us-east-2.compute.internal

llm

e2e-same-id-b-0d5ad972

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-same-id-b-0d5ad972

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-0d5ad972

openshift-ingress

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-59c66b786f-x5rr8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59c66b786f-x5rr8 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd to ip-10-0-137-175.us-east-2.compute.internal

llm

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

Scheduled

Successfully assigned llm/e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp to ip-10-0-133-52.us-east-2.compute.internal

llm

e2e-same-id-a-0d5ad972

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-0d5ad972

openshift-ingress

kube-auth-proxy-59c66b786f-wwjm6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59c66b786f-wwjm6 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

router-default-846f8d77f5-km598

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-846f8d77f5-km598

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-846f8d77f5-km598

Scheduled

Successfully assigned openshift-ingress/router-default-846f8d77f5-km598 to ip-10-0-137-175.us-east-2.compute.internal

llm

e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

Scheduled

Successfully assigned llm/e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj to ip-10-0-133-52.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl to ip-10-0-133-52.us-east-2.compute.internal

ai-tenants

e2e-api-b-6afe1a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-6afe1a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-e83b4b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-e83b4b: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s to ip-10-0-136-26.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-fhmpr to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-hgh74

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-hgh74 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk to ip-10-0-136-26.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-7bbf46bdb7-57pw7

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-7bbf46bdb7-57pw7 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q to ip-10-0-133-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-7c8545db6f-mmvnk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7c8545db6f-mmvnk to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86 to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-022966d4-977867645-x62z2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-022966d4-977867645-x62z2 to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-22g4n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-22g4n to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-b2vf7 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k44gg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k44gg to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6 to ip-10-0-137-175.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-845fb4dc4b-zrvgp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-845fb4dc4b-zrvgp to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-processing-68b4f896d-pxw6w

Scheduled

Successfully assigned openshift-ingress/payload-processing-68b4f896d-pxw6w to ip-10-0-133-52.us-east-2.compute.internal

llm

e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

Scheduled

Successfully assigned llm/e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-5ff9ddc8d7-c89gd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5ff9ddc8d7-c89gd to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr to ip-10-0-133-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-845fb4dc4b-s2wjz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-845fb4dc4b-s2wjz to ip-10-0-133-52.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-mcmdt

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-mcmdt to ip-10-0-136-26.us-east-2.compute.internal

llm

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Scheduled

Successfully assigned llm/e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-r5wf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-r5wf2 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q to ip-10-0-136-26.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw to ip-10-0-136-26.us-east-2.compute.internal

opendatahub

test-curl-7426-685ca3

Scheduled

Successfully assigned opendatahub/test-curl-7426-685ca3 to ip-10-0-137-175.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw to ip-10-0-133-52.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-846f8d77f5 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-846f8d77f5

SuccessfulCreate

Created pod: router-default-846f8d77f5-km598
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-846f8d77f5-km598

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-846f8d77f5-km598

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-846f8d77f5-km598

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-846f8d77f5-km598

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-846f8d77f5-km598

Created

Container created

openshift-ingress

multus

router-default-846f8d77f5-km598

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-846f8d77f5-km598

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-hgh74

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-hgh74

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.49s (3.49s including waiting). Image size: 185476477 bytes.

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-ljtcq

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-666dbc6559

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-ljtcq

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fd4b99879 from 0 to 1

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-666dbc6559 from 0 to 1

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.073s (4.073s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-666dbc6559-984rv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.684s (8.684s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-689bcf9f9

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-689bcf9f9-lvm4r

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-689bcf9f9

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-689bcf9f9-kjj7f

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-689bcf9f9 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-689bcf9f9

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-689bcf9f9-nwc4n

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.876s (3.876s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.84s (3.84s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.671s (3.671s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-689bcf9f9-lvm4r_284bf4ea-b377-4d35-9531-e6017748c119

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-689bcf9f9-lvm4r_284bf4ea-b377-4d35-9531-e6017748c119 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 436ms (436ms including waiting). Image size: 273709574 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-vpd4j

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-kjj7f

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 500ms (500ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-lvm4r

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 517ms (517ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-689bcf9f9-nwc4n

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-sxxmt

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-mcmdt

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mcmdt

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-mcmdt

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-msx7k

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-fxgzj
(x8)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

authorino-operator-7b7bb4bc77-msx7k

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-msx7k

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mcmdt

Started

Container started

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-fxgzj

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mcmdt

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mcmdt

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.568s (3.568s including waiting). Image size: 224874686 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-fxgzj

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-mcmdt_d89a4a7d-323f-4977-b85b-053060cc1d00 became leader

openshift-ingress

replicaset-controller

kube-auth-proxy-59c66b786f

SuccessfulCreate

Created pod: kube-auth-proxy-59c66b786f-wwjm6

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-79f98cb86f from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-79f98cb86f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-9hf26

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

kuadrant-system

authorino-operator-7b7bb4bc77-msx7k_b13179f6-97d5-4048-bff1-bc2b7d46d438

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-msx7k_b13179f6-97d5-4048-bff1-bc2b7d46d438 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-msx7k

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.897s (2.897s including waiting). Image size: 167738465 bytes.

openshift-ingress

replicaset-controller

kube-auth-proxy-59c66b786f

SuccessfulCreate

Created pod: kube-auth-proxy-59c66b786f-x5rr8

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-59c66b786f from 0 to 2

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-9hf26

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-9hf26

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-wwjm6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-59c66b786f-x5rr8

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-ingress

multus

kube-auth-proxy-59c66b786f-wwjm6

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-vjdvl

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-79f98cb86fbgwkn

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-x5rr8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-fxgzj

Created

Container created

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-sxxmt_d9c84d03-581f-44f2-8ead-814ac940a7ab

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-sxxmt_d9c84d03-581f-44f2-8ead-814ac940a7ab became leader

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-trh22

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-fxgzj

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.333s (4.333s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-fxgzj

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-vjdvl

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 10.115s (10.115s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vjdvl

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-9hf26

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.136s (3.136s including waiting). Image size: 190804149 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-x5rr8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.452s (2.452s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-x5rr8

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vjdvl

Created

Container created

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-trh22

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-trh22

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-wwjm6

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vjdvl

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 898ms (898ms including waiting). Image size: 309650901 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-wwjm6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.603s (2.603s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-x5rr8

Started

Container started

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vjdvl

Started

Container started

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-rrr99

openshift-ingress

kubelet

kube-auth-proxy-59c66b786f-wwjm6

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rrr99

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-trh22

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.798s (1.798s including waiting). Image size: 195729000 bytes.

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-rrr99

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

dns-operator-controller-manager-8557cbdb84-9hf26_b3a05ac7-aba9-40f9-a884-54a4fbebff67

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-9hf26_b3a05ac7-aba9-40f9-a884-54a4fbebff67 became leader

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-trh22

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-rfv55

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-trh22

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-rfv55

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-rfv55

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-rfv55

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-597b95cb84-rfv55

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes
(x9)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

kuadrant-system

limitador-operator-controller-manager-5778bb4449-rrr99_0eef3de6-e1d3-4241-9de2-858c7a83d99e

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-rrr99_0eef3de6-e1d3-4241-9de2-858c7a83d99e became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rrr99

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.81s (3.81s including waiting). Image size: 177967631 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-59thg

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-59thg

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-59thg

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-59thg

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-59thg

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-59thg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.388s (4.388s including waiting). Image size: 424244516 bytes.

opendatahub

kserve-module-controller-manager-7566cf5fc8-trh22_de9ed869-9649-489e-80da-b7019e03b9c6

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-trh22_de9ed869-9649-489e-80da-b7019e03b9c6 became leader

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-mm2nc"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-q54w5"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-7bbf46bdb7

SuccessfulCreate

Created pod: jobset-controller-manager-7bbf46bdb7-57pw7

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-7bbf46bdb7 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-7bbf46bdb7-57pw7

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-7bbf46bdb7-57pw7

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-sxxmt

openshift-jobset-operator

kubelet

jobset-controller-manager-7bbf46bdb7-57pw7

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.954s (4.954s including waiting). Image size: 182184678 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-sxxmt

Killing

Stopping container manager

openshift-jobset-operator

jobset-controller-manager-7bbf46bdb7-57pw7_9a68499a-b93c-4a71-8a90-3594f9aeb384

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-7bbf46bdb7-57pw7_9a68499a-b93c-4a71-8a90-3594f9aeb384 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-7bbf46bdb7-57pw7

Started

Container started

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

openshift-jobset-operator

kubelet

jobset-controller-manager-7bbf46bdb7-57pw7

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-jtc4h

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-v5k66

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-59thg_7f1bc8f4-9d9b-4d5a-9d1e-e0fc357a98e2

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-59thg_7f1bc8f4-9d9b-4d5a-9d1e-e0fc357a98e2 became leader

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-5fx26

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-5fx26

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-5fx26

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-pkn6m

kuadrant-system

kubelet

authorino-57f7f8659f-pkn6m

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-pkn6m

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-v5k66

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-v5k66

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jtc4h

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-jtc4h

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-qf7xf

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-v5k66

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-v5k66

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.176s (1.176s including waiting). Image size: 133379307 bytes.

kuadrant-system

multus

authorino-56c6c9ddd5-qf7xf

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-qf7xf

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-v5k66

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jtc4h

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jtc4h

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jtc4h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.332s (1.332s including waiting). Image size: 133379307 bytes.

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-jbfsn

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-w6g7x

kuadrant-system

kubelet

authorino-57f7f8659f-pkn6m

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.084s (3.084s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-pkn6m

Started

Container started

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-x9p74

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-cj2xb

kuadrant-system

kubelet

authorino-57f7f8659f-pkn6m

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-qf7xf

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-qf7xf

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-qf7xf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.645s (2.645s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-k44gg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-w6g7x

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k44gg

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-k44gg

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-5fx26

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k44gg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-pkn6m

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k44gg

Created

Container created

opendatahub

multus

model-serving-api-75bd89fdfc-jbfsn

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-jbfsn

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-cj2xb

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-cj2xb

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

kserve-controller-manager-776cc66d47-x9p74

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-5fx26

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.643s (5.643s including waiting). Image size: 342538866 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w6g7x

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

kserve-controller-manager-776cc66d47-x9p74

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-5fx26

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-hgh74

kuadrant-system

kubelet

authorino-57f7f8659f-pkn6m

Killing

Stopping container authorino

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-hgh74

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-jbfsn

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-jbfsn

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-cj2xb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.866s (2.866s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-cj2xb

Started

Container started

opendatahub

odh-model-controller-769875db56-cj2xb_53728b47-4473-44c1-be51-6257f20acb6e

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-cj2xb_53728b47-4473-44c1-be51-6257f20acb6e became leader

opendatahub

kubelet

model-serving-api-75bd89fdfc-jbfsn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.813s (2.813s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-cj2xb

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-x9p74

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.895s (3.895s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w6g7x

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-x9p74

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w6g7x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.873s (3.873s including waiting). Image size: 235100981 bytes.

opendatahub

kserve-controller-manager-776cc66d47-x9p74_b65e0b87-345a-4cf8-9fc8-d453970b8631

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-x9p74_b65e0b87-345a-4cf8-9fc8-d453970b8631 became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w6g7x

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-x9p74

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-w6g7x_a09e6c90-e6f8-4b3c-bd7f-5bf1fe871967

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-w6g7x_a09e6c90-e6f8-4b3c-bd7f-5bf1fe871967 became leader

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-jtc4h

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jtc4h

Killing

Stopping container limitador
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

maas-controller-7f9f878d4b

SuccessfulCreate

Created pod: maas-controller-7f9f878d4b-fwg8j

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7f9f878d4b from 0 to 1

opendatahub

replicaset-controller

maas-controller-7f997f45fb

SuccessfulCreate

Created pod: maas-controller-7f997f45fb-9tqcn

opendatahub

kubelet

maas-controller-7f997f45fb-9tqcn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5"

opendatahub

multus

maas-controller-7f9f878d4b-fwg8j

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

opendatahub

multus

maas-controller-7f997f45fb-9tqcn

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7f9f878d4b-fwg8j

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5"
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

maas-controller-7f9f878d4b-fwg8j

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5" in 4.038s (4.038s including waiting). Image size: 200094740 bytes.

opendatahub

kubelet

maas-controller-7f997f45fb-9tqcn

Started

Container started

opendatahub

kubelet

maas-controller-7f997f45fb-9tqcn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5" in 3.597s (3.597s including waiting). Image size: 200094740 bytes.

opendatahub

kubelet

maas-controller-7f997f45fb-9tqcn

Created

Container created

opendatahub

kubelet

maas-controller-7f9f878d4b-fwg8j

Created

Container created

opendatahub

kubelet

maas-controller-7f9f878d4b-fwg8j

Started

Container started

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

maas-controller-7f9f878d4b-fwg8j_27136ded-070e-48cb-af47-976a9ffe1a21

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7f9f878d4b-fwg8j_27136ded-070e-48cb-af47-976a9ffe1a21 became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7f9f878d4b-fwg8j

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7f9f878d4b from 1 to 0

opendatahub

replicaset-controller

maas-controller-7f9f878d4b

SuccessfulDelete

Deleted pod: maas-controller-7f9f878d4b-fwg8j

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9hj4l

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.267s (12.267s including waiting). Image size: 1089502687 bytes.

opendatahub

maas-controller-7f997f45fb-9tqcn_f8737f99-66eb-494f-b23d-62a0f8033de8

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7f997f45fb-9tqcn_f8737f99-66eb-494f-b23d-62a0f8033de8 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

ProbeError

Readiness probe error: Get "http://10.133.0.22:15021/healthz/ready": read tcp 10.133.0.2:43226->10.133.0.22:15021: read: connection reset by peer body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.22:15021/healthz/ready": read tcp 10.133.0.2:43226->10.133.0.22:15021: read: connection reset by peer

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6dd76875b5 from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6dd76875b5 from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Started

Container started

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulCreate

Created pod: authorino-6dd76875b5-xj4fd

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulDelete

Deleted pod: authorino-6dd76875b5-xj4fd

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-csx4b

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-564698f58b from 0 to 1

kuadrant-system

kubelet

authorino-564698f58b-mv8bw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

multus

authorino-6889cbd8c4-csx4b

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

kuadrant-system

multus

authorino-564698f58b-mv8bw

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-564698f58b

SuccessfulCreate

Created pod: authorino-564698f58b-mv8bw

kuadrant-system

kubelet

authorino-6889cbd8c4-csx4b

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-csx4b

kuadrant-system

kubelet

authorino-6889cbd8c4-csx4b

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.491s (1.491s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-csx4b

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-csx4b

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-csx4b

Killing

Stopping container authorino
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

authorino-564698f58b-mv8bw

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-qf7xf

kuadrant-system

kubelet

authorino-56c6c9ddd5-qf7xf

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-564698f58b-mv8bw

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-564698f58b-mv8bw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.347s (2.347s including waiting). Image size: 204096810 bytes.

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-vtpsz

opendatahub

multus

llmisvc-controller-manager-6466c554d8-vtpsz

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vtpsz

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Unhealthy

Startup probe failed: Get "http://10.133.0.22:15021/healthz/ready": dial tcp 10.133.0.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

ProbeError

Startup probe error: Get "http://10.133.0.22:15021/healthz/ready": dial tcp 10.133.0.22:15021: connect: connection refused body:

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vtpsz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 356ms (356ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vtpsz

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vtpsz

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-w6g7x

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-w6g7x

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

multus

ai-gateway-controller-7d85675f98-rgmfq

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-rgmfq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-rgmfq

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-rgmfq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.734s (2.734s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-rgmfq

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-rgmfq

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-rgmfq_4102efd3-7476-4023-919c-acc869de414c

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-rgmfq_4102efd3-7476-4023-919c-acc869de414c became leader

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-r5wf2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-wwqfh

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wwqfh

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-wwqfh

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-55fbbbf9dc-r5wf2

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r5wf2

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wwqfh

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r5wf2

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r5wf2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.564s (2.564s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wwqfh

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r5wf2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wwqfh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.297s (2.297s including waiting). Image size: 125353963 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-f9d557c9 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-f9d557c9

SuccessfulCreate

Created pod: ai-gateway-controller-f9d557c9-9x2z8

opendatahub

multus

ai-gateway-controller-f9d557c9-9x2z8

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-f9d557c9-9x2z8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-f9d557c9-9x2z8

Started

Container started

opendatahub

kubelet

ai-gateway-controller-f9d557c9-9x2z8

Created

Container created

opendatahub

kubelet

ai-gateway-controller-f9d557c9-9x2z8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 481ms (481ms including waiting). Image size: 183979433 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-vtpsz_0cb9c82a-b069-409b-8462-d29c0860caee

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-vtpsz_0cb9c82a-b069-409b-8462-d29c0860caee became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-rgmfq

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-rgmfq

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.481s (1.481s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-5cqq2

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 289ms (289ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qvfwp

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-94gsr

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.159s (1.159s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fhmpr

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-94gsr

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-94gsr

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-94gsr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-94gsr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 307ms (307ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-94gsr

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 302ms (302ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-bl4xv

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-bl4xv

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8t7zf2

Created

Container created

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bl4xv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

opendatahub

ai-gateway-controller-f9d557c9-9x2z8_fa611213-b70a-4b90-9eb3-ed8efdda8408

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-f9d557c9-9x2z8_fa611213-b70a-4b90-9eb3-ed8efdda8408 became leader

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

Started

Container started

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bl4xv

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bl4xv

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bl4xv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.816s (1.816s including waiting). Image size: 78208878 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7cp9c

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 323ms (323ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 302ms (302ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Created

Container created

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

kuadrant-system

kubelet

authorino-6d8bc659cc-72rg2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6d8bc659cc

SuccessfulCreate

Created pod: authorino-6d8bc659cc-72rg2

kuadrant-system

multus

authorino-6d8bc659cc-72rg2

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-564698f58b-mv8bw

Killing

Stopping container authorino
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-564698f58b from 1 to 0

kuadrant-system

replicaset-controller

authorino-564698f58b

SuccessfulDelete

Deleted pod: authorino-564698f58b-mv8bw

kuadrant-system

kubelet

authorino-6d8bc659cc-72rg2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 995ms (995ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6d8bc659cc-72rg2

Started

Container started

kuadrant-system

kubelet

authorino-6d8bc659cc-72rg2

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fd4b99879 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-c6qrt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-8v5dc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-m6sln

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-8v5dc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-8v5dc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6sln

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6sln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-8v5dc

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-m6sln

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-8v5dc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6sln

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-c6qrt

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.141s (3.141s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6sln

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6sln

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-8v5dc

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-8v5dc

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-jmn77

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fd4b99879 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-jsxtq

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-m6qv8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-s4pct

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jmn77

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-s4pct

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-jmn77

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jmn77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jmn77

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-m6qv8

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-jsxtq

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-3a6480

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-3a6480

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-0aa61b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-0aa61b

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-e27ae7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-e27ae7

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-3a6480

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-3a6480-84cb444cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3a6480-84cb444cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-3a6480-84cb444cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3a6480: serviceaccount "payload-processing-e2e-worker-w0-3a6480" not found
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jmn77

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jmn77

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-3a6480: serviceaccount "payload-processing-e2e-worker-w0-3a6480" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-3a6480

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-e27ae7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-3a6480-84cb444cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e27ae7: serviceaccount "payload-processing-e2e-worker-w2-e27ae7" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e27ae7-7dc769584f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-e27ae7-7dc769584f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e27ae7: serviceaccount "payload-processing-e2e-worker-w2-e27ae7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e27ae7-7dc769584f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-e27ae7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-e27ae7-7dc769584f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-0aa61b: serviceaccount "payload-processing-e2e-worker-w4-0aa61b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-0aa61b: serviceaccount "payload-processing-e2e-worker-w4-0aa61b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-0aa61b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-0aa61b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.512s (2.512s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.602s (2.602s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.334s (2.334s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-fl2rn

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fd4b99879 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-fd4b99879-bnsdt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-bnsdt

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-fl2rn

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9

SuccessfulCreate

Created pod: e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

openshift-ingress

deployment-controller

e2e-inf-a-e3c4a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e3c4a7-openshift-default-77d45d48b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e3c4a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e3c4a7

openshift-ingress

multus

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e3c4a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e3c4a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e3c4a7: serviceaccount "payload-processing-e2e-inf-a-e3c4a7" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e3c4a7: serviceaccount "payload-processing-e2e-inf-a-e3c4a7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4a127b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4a127b

openshift-ingress

deployment-controller

e2e-inf-b-4a127b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4a127b-openshift-default-6bf94b6c47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-4a127b-openshift-default-6bf94b6c47

SuccessfulCreate

Created pod: e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

openshift-ingress

multus

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4a127b: serviceaccount "payload-processing-e2e-inf-b-4a127b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4a127b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4a127b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4a127b-5f46976497 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4a127b-5f46976497

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4a127b-5f46976497

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4a127b-5f46976497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4a127b: serviceaccount "payload-processing-e2e-inf-b-4a127b" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 1 to 2

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4a127b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4a127b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e3c4a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e3c4a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Created

Container created

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4a127b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4a127b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

opendatahub

kubelet

test-curl-7417-4a3db9

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7417-4a3db9

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

opendatahub

kubelet

test-curl-7417-4a3db9

Created

Container created

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7417-4a3db9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7417-4a3db9

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.37s (2.37s including waiting). Image size: 106100986 bytes.

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

opendatahub

multus

test-curl-7417-a77bc6

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7417-a77bc6

Created

Container created

opendatahub

kubelet

test-curl-7417-a77bc6

Started

Container started

opendatahub

kubelet

test-curl-7417-a77bc6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7417-4a3db9

Killing

Stopping container test-curl-7417-4a3db9

opendatahub

kubelet

test-curl-7417-a77bc6

Killing

Stopping container test-curl-7417-a77bc6

openshift-ingress

replicaset-controller

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c

SuccessfulCreate

Created pod: e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

openshift-ingress

multus

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-e38ef4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-e38ef4

openshift-ingress

deployment-controller

e2e-extmod-a-e38ef4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e38ef4: serviceaccount "payload-processing-e2e-extmod-a-e38ef4" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e38ef4: serviceaccount "payload-processing-e2e-extmod-a-e38ef4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-e38ef4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-e38ef4-64c649c7fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-e38ef4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 4 to 5

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e38ef4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e38ef4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Started

Container started

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 5 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-5370bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-5370bb

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulCreate

Created pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

openshift-ingress

multus

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Unhealthy

Readiness probe failed: Get "http://10.132.0.92:15021/healthz/ready": read tcp 10.132.0.2:38578->10.132.0.92:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5370bb-648c6878bc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-5370bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-5370bb-648c6878bc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5370bb-648c6878bc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-5370bb-648c6878bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5370bb: serviceaccount "payload-processing-e2e-extmod-b-5370bb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5370bb: serviceaccount "payload-processing-e2e-extmod-b-5370bb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-5370bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

ProbeError

Readiness probe error: Get "http://10.132.0.92:15021/healthz/ready": read tcp 10.132.0.2:38578->10.132.0.92:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 5 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 6 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

Started

Container started

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Unhealthy

Liveness probe failed: Get "https://10.132.0.61:8000/health": context deadline exceeded
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e38ef4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e38ef4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-b2vf7

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.343s (4.343s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-e3c4a7-openshift-default-77d45d48b9-ns4lq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 9 to 10

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

Killing

Stopping container payload-pre-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-4a127b-openshift-default-6bf94b6c47-7d9vx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-praxis-a-638f19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-638f19-openshift-default-544bc89849 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-638f19-openshift-default-544bc89849

SuccessfulCreate

Created pod: e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-638f19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-638f19
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e3c4a7-574b6d4b8c-m86t4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e3c4a7-84d76cbb47-b8z7m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-638f19: serviceaccount "payload-processing-e2e-praxis-a-638f19" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-638f19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-638f19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-638f19-55f6fff6f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-638f19-55f6fff6f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-638f19-55f6fff6f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-638f19-55f6fff6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-638f19: serviceaccount "payload-processing-e2e-praxis-a-638f19" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4a127b-5f46976497-2lp9b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4a127b-9b6d68d75-bkgs5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-7f0c86-openshift-default-6987bb768f

SuccessfulCreate

Created pod: e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

openshift-ingress

deployment-controller

e2e-praxis-b-7f0c86-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-7f0c86-openshift-default-6987bb768f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-7f0c86

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-7f0c86

openshift-ingress

multus

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:39272->10.134.0.58:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": read tcp 10.134.0.2:39272->10.134.0.58:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7f0c86: serviceaccount "payload-processing-e2e-praxis-b-7f0c86" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-7f0c86

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-7f0c86-946796b95 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-7f0c86

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7f0c86: serviceaccount "payload-processing-e2e-praxis-b-7f0c86" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.61:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-638f19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7f0c86-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7f0c86-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-638f19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x15)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.61:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

ProbeError

Readiness probe error: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Unhealthy

Readiness probe failed: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7f0c86-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7f0c86-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-638f19-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-638f19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-638f19-openshift-default-544bc89849 from 1 to 2

openshift-ingress

replicaset-controller

e2e-praxis-a-638f19-openshift-default-544bc89849

SuccessfulCreate

Created pod: e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulCreate

Created pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-29b57c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-29b57c-openshift-default-594b494869 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-29b57c-openshift-default-594b494869

SuccessfulCreate

Created pod: e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-29b57c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-29b57c

openshift-ingress

multus

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-29b57c: serviceaccount "payload-processing-e2e-extmod-a-29b57c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-29b57c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-29b57c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-29b57c-85958bc8ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-29b57c-85958bc8ff

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-29b57c-85958bc8ff

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-29b57c-85958bc8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-29b57c: serviceaccount "payload-processing-e2e-extmod-a-29b57c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-extmod-b-bccce1-openshift-default-79b58b586f

SuccessfulCreate

Created pod: e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-bccce1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-bccce1

openshift-ingress

deployment-controller

e2e-extmod-b-bccce1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bccce1-openshift-default-79b58b586f from 0 to 1

openshift-ingress

multus

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-0ebb0cff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0ebb0cff-openshift-default-55464d4cbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-0ebb0cff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0ebb0cff

openshift-ingress

replicaset-controller

e2e-ait-0ebb0cff-openshift-default-55464d4cbf

SuccessfulCreate

Created pod: e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

openshift-ingress

multus

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-bccce1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-bccce1-5b9f8747f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-bccce1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bccce1: serviceaccount "payload-processing-e2e-extmod-b-bccce1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bccce1: serviceaccount "payload-processing-e2e-extmod-b-bccce1" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0ebb0cff: serviceaccount "payload-processing-e2e-ait-0ebb0cff" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0ebb0cff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0ebb0cff: serviceaccount "payload-processing-e2e-ait-0ebb0cff" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0ebb0cff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-22g4n

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-22g4n

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-22g4n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-22g4n

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-22g4n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.172s (3.172s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-22g4n

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0ebb0cff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0ebb0cff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 2 to 3

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulCreate

Created pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0ebb0cff-7bcc55b8cf-89s86

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0ebb0cff-774dd8786c-7xthb

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": read tcp 10.134.0.2:39352->10.134.0.71:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": read tcp 10.134.0.2:39352->10.134.0.71:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

kubelet

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bccce1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bccce1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-0ebb0cff-openshift-default-55464d4cbf-n4bk9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-91f1523a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-91f1523a-gw

openshift-ingress

replicaset-controller

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9

SuccessfulCreate

Created pod: e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

openshift-ingress

multus

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-91f1523a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-91f1523a-899695877

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-91f1523a-899695877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-91f1523a: serviceaccount "payload-processing-e2e-migrate-91f1523a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-91f1523a: serviceaccount "payload-processing-e2e-migrate-91f1523a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-91f1523a-899695877

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-91f1523a-899695877-8wlls

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-91f1523a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-91f1523a-899695877 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-91f1523a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-91f1523a-899695877-8wlls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-91f1523a-899695877-8wlls

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-91f1523a-899695877-8wlls

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-91f1523a-899695877-8wlls

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-frtbc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-638f19-openshift-default-544bc89849-psmmw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-638f19-749f6b8d8c-8gmwl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-638f19-55f6fff6f7-2c7dd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bccce1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bccce1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7f0c86-946796b95-bbvrc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7f0c86-84cd8cd7d9-pfqdn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-91f1523a-7fcf94b5c5-4txh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-91f1523a-899695877-8wlls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-91f1523a-gw-openshift-default-dockercfg-rltn7); attempting to pull the image may not succeed.
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-91f1523a-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-91f1523a-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-912c8c21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-912c8c21
(x2)

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-912c8c21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-912c8c21-openshift-default-78674f977f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-912c8c21-openshift-default-78674f977f

SuccessfulCreate

Created pod: e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

openshift-ingress

multus

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

Started

Container started

openshift-ingress

kubelet

e2e-migrate-91f1523a-gw-openshift-default-64b5bfb9d9-jkqtq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

Created

Container created

openshift-ingress

kubelet

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-912c8c21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-912c8c21-78644bcb4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-912c8c21-78644bcb4f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-912c8c21-78644bcb4f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-912c8c21-78644bcb4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-912c8c21: serviceaccount "payload-processing-e2e-ait-912c8c21" not found
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-912c8c21-d4b769575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-912c8c21-d4b769575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-912c8c21: serviceaccount "payload-processing-e2e-ait-912c8c21" not found
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-912c8c21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-912c8c21-d4b769575 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-912c8c21-d4b769575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-566dcd79c7 from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

replicaset-controller

payload-processing-external-model-566dcd79c7

SuccessfulCreate

Created pod: payload-processing-external-model-566dcd79c7-n9nvf
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-566dcd79c7

FailedCreate

Error creating: pods "payload-processing-external-model-566dcd79c7-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

kubelet

e2e-praxis-b-7f0c86-openshift-default-6987bb768f-n25xc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

models-as-a-service

kubelet

payload-processing-external-model-566dcd79c7-n9nvf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-566dcd79c7-n9nvf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-566dcd79c7-n9nvf

Started

Container started

models-as-a-service

multus

payload-processing-external-model-566dcd79c7-n9nvf

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-912c8c21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-912c8c21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-912c8c21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-912c8c21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-912c8c21-d4b769575-dmsdz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-912c8c21-78644bcb4f-qp576

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-29b57c-openshift-default-594b494869

SuccessfulCreate

Created pod: e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

openshift-ingress

deployment-controller

e2e-extmod-a-29b57c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-29b57c-openshift-default-594b494869 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Started

Container started

openshift-ingress

kubelet

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-9b54c8e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5

SuccessfulCreate

Created pod: e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

openshift-ingress

gateway_labeler_controller

e2e-ait-9b54c8e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9b54c8e3

openshift-ingress

multus

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9b54c8e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9b54c8e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9b54c8e3-5c67cb5cc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9b54c8e3: serviceaccount "payload-processing-e2e-ait-9b54c8e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9b54c8e3: serviceaccount "payload-processing-e2e-ait-9b54c8e3" not found

openshift-ingress

multus

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Unhealthy

Liveness probe failed: Get "https://10.132.0.61:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

Created

Container created

openshift-ingress

kubelet

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": read tcp 10.134.0.2:47106->10.134.0.84:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-912c8c21-openshift-default-78674f977f-ndvnc

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": read tcp 10.134.0.2:47106->10.134.0.84:15021: read: connection reset by peer

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9b54c8e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9b54c8e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9b54c8e3-79f574d7f9-4gm8r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9b54c8e3-5c67cb5cc-nxxc4

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-566dcd79c7-n9nvf

Killing

Stopping container payload-processing
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-7c8545db6f

FailedCreate

Error creating: pods "payload-processing-external-model-7c8545db6f-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7c8545db6f from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7c8545db6f

SuccessfulCreate

Created pod: payload-processing-external-model-7c8545db6f-mmvnk

models-as-a-service

multus

payload-processing-external-model-7c8545db6f-mmvnk

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9b54c8e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-mmvnk

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-9b54c8e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-mmvnk

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-mmvnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-mmvnk

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7c8545db6f

SuccessfulCreate

Created pod: payload-processing-external-model-7c8545db6f-llqbv

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7c8545db6f from 0 to 1

openshift-ingress

kubelet

e2e-ait-9b54c8e3-openshift-default-5bc4dbb5f5-l9xdd

Killing

Stopping container istio-proxy
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-7c8545db6f

FailedCreate

Error creating: pods "payload-processing-external-model-7c8545db6f-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

gateway_labeler_controller

e2e-derive-ea421713

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ea421713

openshift-ingress

replicaset-controller

e2e-derive-ea421713-openshift-default-7f4cbfcf9c

SuccessfulCreate

Created pod: e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-llqbv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-llqbv

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7c8545db6f-llqbv

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-llqbv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7c8545db6f-llqbv

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-derive-ea421713-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ea421713-openshift-default-7f4cbfcf9c from 0 to 1

openshift-ingress

multus

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-598fcbc94f

FailedCreate

Error creating: pods "payload-processing-external-model-598fcbc94f-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-598fcbc94f

SuccessfulCreate

Created pod: payload-processing-external-model-598fcbc94f-mgqwx

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-598fcbc94f from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-598fcbc94f-mgqwx

Started

Container started

models-as-a-service

multus

payload-processing-external-model-598fcbc94f-mgqwx

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-598fcbc94f-mgqwx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-598fcbc94f-mgqwx

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-598fcbc94f-mgqwx

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ea421713-8655f769f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ea421713-8655f769f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ea421713: serviceaccount "payload-processing-e2e-derive-ea421713" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ea421713-6f77d8496c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ea421713-6f77d8496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ea421713: serviceaccount "payload-processing-e2e-derive-ea421713" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ea421713

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ea421713-6f77d8496c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ea421713

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ea421713-8655f769f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ea421713-8655f769f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ea421713-6f77d8496c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

openshift-ingress

replicaset-controller

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c

SuccessfulCreate

Created pod: e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

openshift-ingress

deployment-controller

e2e-worker-w3-9de2ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-9de2ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-9de2ac

openshift-ingress

multus

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

Created

Container created

openshift-ingress

multus

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9de2ac-6b849b9989

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9de2ac-6b849b9989

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-9de2ac-6b849b9989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9de2ac: serviceaccount "payload-processing-e2e-worker-w3-9de2ac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-9de2ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-9de2ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-9de2ac-6b849b9989 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9de2ac: serviceaccount "payload-processing-e2e-worker-w3-9de2ac" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ea421713-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ea421713-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w1-9be196-openshift-default-df667f8b9

SuccessfulCreate

Created pod: e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

openshift-ingress

deployment-controller

e2e-shared-a-w1-9be196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-9be196-openshift-default-df667f8b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-9be196

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-9be196

openshift-ingress

multus

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ea421713-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ea421713-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-9be196

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-9be196

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-9be196: serviceaccount "payload-processing-e2e-shared-a-w1-9be196" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-9be196: serviceaccount "payload-processing-e2e-shared-a-w1-9be196" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ea421713-8655f769f-g2lqr

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 3 to 4

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Unhealthy

Readiness probe failed: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

ProbeError

Readiness probe error: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulCreate

Created pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

openshift-ingress

multus

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ea421713-openshift-default-7f4cbfcf9c-xjvbs

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-a-aaea41-openshift-default-67cb954d5

SuccessfulCreate

Created pod: e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

openshift-ingress

deployment-controller

e2e-extmod-a-aaea41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-aaea41-openshift-default-67cb954d5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-aaea41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-aaea41

openshift-ingress

multus

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ea421713-6f77d8496c-76sgq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.107:50052" within 1s: context deadline exceeded
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-aaea41-db75c5f57

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-aaea41-db75c5f57

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-aaea41-db75c5f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-aaea41: serviceaccount "payload-processing-e2e-extmod-a-aaea41" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-aaea41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-aaea41-db75c5f57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-aaea41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-aaea41: serviceaccount "payload-processing-e2e-extmod-a-aaea41" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bccce1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-bccce1-openshift-default-79b58b586f

SuccessfulCreate

Created pod: e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-bccce1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bccce1-openshift-default-79b58b586f from 1 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

Created

Container created

openshift-ingress

multus

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-e83b4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-e83b4b

openshift-ingress

deployment-controller

e2e-shared-b-w1-e83b4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-e83b4b-openshift-default-944f5867f from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

ProbeError

Startup probe error: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

Unhealthy

Startup probe failed: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f

SuccessfulCreate

Created pod: e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

openshift-ingress

multus

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-29b57c-openshift-default-594b494869

SuccessfulCreate

Created pod: e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

openshift-ingress

multus

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-29b57c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-29b57c-openshift-default-594b494869 from 2 to 3

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-e83b4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-e83b4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-e83b4b: serviceaccount "payload-processing-e2e-shared-b-w1-e83b4b" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-e83b4b: serviceaccount "payload-processing-e2e-shared-b-w1-e83b4b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

ProbeError

Readiness probe error: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Unhealthy

Readiness probe failed: Get "http://10.132.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-b-6f810f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6f810f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6f810f

openshift-ingress

replicaset-controller

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9

SuccessfulCreate

Created pod: e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9de2ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9de2ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6f810f: serviceaccount "payload-processing-e2e-extmod-b-6f810f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6f810f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6f810f: serviceaccount "payload-processing-e2e-extmod-b-6f810f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6f810f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9de2ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9de2ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaea41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaea41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-9be196-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-9be196-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulDelete

Deleted pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-cvstl

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-fpw8k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c

SuccessfulCreate

Created pod: e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-9de2ac-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-9de2ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

Started

Container started

openshift-ingress

multus

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

ProbeError

Readiness probe error: Get "http://10.132.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Unhealthy

Readiness probe failed: Get "http://10.132.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaea41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaea41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w1-9be196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-9be196-openshift-default-df667f8b9 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w1-9be196-openshift-default-df667f8b9

SuccessfulCreate

Created pod: e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-9be196-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

Started

Container started

openshift-ingress

multus

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-68f76b7b94

FailedCreate

Error creating: pods "payload-processing-external-model-68f76b7b94-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-68f76b7b94

SuccessfulCreate

Created pod: payload-processing-external-model-68f76b7b94-ghwhj

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-68f76b7b94 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-68f76b7b94-ghwhj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-68f76b7b94-ghwhj

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-68f76b7b94-ghwhj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-68f76b7b94-ghwhj

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6f810f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6f810f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e83b4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e83b4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 10 to 9

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-dwds5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e83b4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e83b4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-7mjcx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-vjwnw

openshift-ingress

deployment-controller

e2e-api-a-3de00d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-3de00d-openshift-default-fb4cd864f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-3de00d-openshift-default-fb4cd864f

SuccessfulCreate

Created pod: e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

openshift-ingress

gateway_labeler_controller

e2e-api-a-3de00d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3de00d

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-79ddbf8d54 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-79ddbf8d54

SuccessfulCreate

Created pod: payload-processing-external-model-79ddbf8d54-gln7d

openshift-ingress

multus

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

models-as-a-service

multus

payload-processing-external-model-79ddbf8d54-gln7d

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-79ddbf8d54-gln7d

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-79ddbf8d54-gln7d

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-79ddbf8d54-gln7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-3de00d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-3de00d-67d9bf7fcf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-3de00d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-3de00d-67d695865f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3de00d-67d9bf7fcf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3de00d-67d695865f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-3de00d-67d695865f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3de00d: serviceaccount "payload-processing-e2e-api-a-3de00d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3de00d-67d9bf7fcf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-3de00d-67d9bf7fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3de00d: serviceaccount "payload-processing-e2e-api-a-3de00d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3de00d-67d695865f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

openshift-ingress

multus

payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-68f76b7b94 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-68f76b7b94

SuccessfulDelete

Deleted pod: payload-processing-external-model-68f76b7b94-ghwhj

models-as-a-service

kubelet

payload-processing-external-model-68f76b7b94-ghwhj

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-845fb4dc4b

SuccessfulCreate

Created pod: payload-processing-external-model-845fb4dc4b-zrvgp

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-zrvgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-zrvgp

Created

Container created

models-as-a-service

multus

payload-processing-external-model-845fb4dc4b-zrvgp

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-zrvgp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-68f76b7b94-ghwhj

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.87:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

e2e-api-b-6afe1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6afe1a-openshift-default-ff85dbf79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-6afe1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6afe1a

openshift-ingress

replicaset-controller

e2e-api-b-6afe1a-openshift-default-ff85dbf79

SuccessfulCreate

Created pod: e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-79ddbf8d54 from 1 to 0

openshift-ingress

multus

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-79ddbf8d54-gln7d

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-79ddbf8d54

SuccessfulDelete

Deleted pod: payload-processing-external-model-79ddbf8d54-gln7d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6afe1a: serviceaccount "payload-processing-e2e-api-b-6afe1a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6afe1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6afe1a-5f58b8d4d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6afe1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6afe1a-797bfdbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6afe1a: serviceaccount "payload-processing-e2e-api-b-6afe1a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.61:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7854fcbcdd from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7854fcbcdd

SuccessfulCreate

Created pod: payload-processing-external-model-7854fcbcdd-m6rzs

models-as-a-service

multus

payload-processing-external-model-7854fcbcdd-m6rzs

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7854fcbcdd-m6rzs

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7854fcbcdd-m6rzs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7854fcbcdd-m6rzs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

Unhealthy

Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

ProbeError

Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-845fb4dc4b

SuccessfulDelete

Deleted pod: payload-processing-external-model-845fb4dc4b-zrvgp

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-845fb4dc4b from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-zrvgp

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3de00d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3de00d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7417-d5327f

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7417-d5327f

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7417-d5327f

Started

Container started

opendatahub

kubelet

test-curl-7417-d5327f

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.451s (2.451s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7417-d5327f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3de00d-67d695865f-zwnlc

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7417-d5327f

Killing

Stopping container test-curl-7417-d5327f

openshift-ingress

kubelet

payload-processing-e2e-api-a-3de00d-67d9bf7fcf-b4d8q

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6afe1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-3de00d-openshift-default-fb4cd864f-z2nrw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6afe1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-845fb4dc4b

SuccessfulCreate

Created pod: payload-processing-external-model-845fb4dc4b-s2wjz
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-845fb4dc4b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-s2wjz

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-s2wjz

Started

Container started

models-as-a-service

multus

payload-processing-external-model-845fb4dc4b-s2wjz

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-s2wjz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-6afe1a-5f58b8d4d5-s7lmk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6afe1a-797bfdbc-n58sf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6afe1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

kubelet

payload-processing-external-model-845fb4dc4b-s2wjz

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-7854fcbcdd-m6rzs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6afe1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-autores-933245-openshift-default-8b8b4856c

SuccessfulCreate

Created pod: e2e-autores-933245-openshift-default-8b8b4856c-nbw24

openshift-ingress

gateway_labeler_controller

e2e-autores-933245

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-933245

openshift-ingress

deployment-controller

e2e-autores-933245-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-933245-openshift-default-8b8b4856c from 0 to 1

openshift-ingress

multus

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-6afe1a-openshift-default-ff85dbf79-zqrcb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-a6873b-openshift-default-d47989c65

SuccessfulCreate

Created pod: e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

openshift-ingress

multus

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-aaea41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-aaea41-openshift-default-67cb954d5 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677

SuccessfulCreate

Created pod: e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaea41-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-aaea41-openshift-default-67cb954d5

SuccessfulCreate

Created pod: e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

openshift-ingress

deployment-controller

e2e-shared-a-w4-8b6cd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-8b6cd6-openshift-default-744b88677 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w1-a6873b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a6873b-openshift-default-d47989c65 from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-a6873b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-a6873b

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-8b6cd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-8b6cd6

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-933245-5cd96d5679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-933245-5cd96d5679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-933245: serviceaccount "payload-processing-e2e-autores-933245" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-933245

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-933245-5cd96d5679 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-933245-5cd96d5679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-933245-6d9bf7cbbf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

openshift-ingress

multus

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-933245-6d9bf7cbbf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-933245-6d9bf7cbbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-933245: serviceaccount "payload-processing-e2e-autores-933245" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-933245

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-933245-6d9bf7cbbf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-a6873b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-a6873b-79d848b447 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-a6873b-79b7f97879

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-a6873b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-a6873b-79b7f97879 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a6873b: serviceaccount "payload-processing-e2e-worker-w1-a6873b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-a6873b-79b7f97879

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-a6873b-79b7f97879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-a6873b: serviceaccount "payload-processing-e2e-worker-w1-a6873b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-8b6cd6: serviceaccount "payload-processing-e2e-shared-a-w4-8b6cd6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-8b6cd6: serviceaccount "payload-processing-e2e-shared-a-w4-8b6cd6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-8b6cd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-8b6cd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x3)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a6873b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a6873b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-036c69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-036c69

openshift-ingress

deployment-controller

e2e-shared-b-w4-036c69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-036c69-openshift-default-8d6df548c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-036c69-openshift-default-8d6df548c

SuccessfulCreate

Created pod: e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

openshift-ingress

multus

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-036c69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-036c69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-036c69: serviceaccount "payload-processing-e2e-shared-b-w4-036c69" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-036c69: serviceaccount "payload-processing-e2e-shared-b-w4-036c69" not found
(x2)

openshift-ingress

kubelet

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8b6cd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8b6cd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

ProbeError

Startup probe error: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Unhealthy

Startup probe failed: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-mp2v7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 9 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8b6cd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a6873b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8b6cd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a6873b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-036c69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-036c69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7426-831cf1

Created

Container created

opendatahub

kubelet

test-curl-7426-831cf1

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7426-831cf1

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7426-831cf1

Started

Container started

opendatahub

kubelet

test-curl-7426-34b933

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7426-34b933

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7426-831cf1

Killing

Stopping container test-curl-7426-831cf1

opendatahub

kubelet

test-curl-7426-34b933

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.291s (1.291s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7426-34b933

Created

Container created

opendatahub

kubelet

test-curl-7426-34b933

Started

Container started

opendatahub

kubelet

test-curl-7426-685ca3

Started

Container started

opendatahub

kubelet

test-curl-7426-685ca3

Created

Container created

opendatahub

kubelet

test-curl-7426-685ca3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7426-685ca3

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7426-34b933

Killing

Stopping container test-curl-7426-34b933

opendatahub

kubelet

test-curl-7426-f8e37f

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7426-685ca3

Killing

Stopping container test-curl-7426-685ca3

opendatahub

multus

test-curl-7426-f8e37f

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7426-f8e37f

Created

Container created

opendatahub

kubelet

test-curl-7426-f8e37f

Started

Container started

opendatahub

kubelet

test-curl-7426-f8e37f

Killing

Stopping container test-curl-7426-f8e37f

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 8 to 7

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 8 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulDelete

Deleted pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-r5t56

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-jt62w

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q5wnk

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulDelete

Deleted pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-78j4p

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-933245-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-933245-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-933245-6d9bf7cbbf-7lxts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-933245-5cd96d5679-jzbhq

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-933245-openshift-default-8b8b4856c-nbw24

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulDelete

Deleted pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-explicit-57d281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-57d281-openshift-default-697dd4cd45 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-57d281

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-57d281

openshift-ingress

replicaset-controller

e2e-explicit-57d281-openshift-default-697dd4cd45

SuccessfulCreate

Created pod: e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 7 to 6

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-kmhr7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-57d281

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-57d281-55d489b495 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-57d281-566d7fb6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-57d281-566d7fb6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-57d281: serviceaccount "payload-processing-e2e-explicit-57d281" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-57d281

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-57d281-566d7fb6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-57d281-55d489b495

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-57d281-566d7fb6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-57d281-55d489b495

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-57d281-55d489b495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-57d281: serviceaccount "payload-processing-e2e-explicit-57d281" not found

openshift-ingress

multus

payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8b6cd6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677

SuccessfulCreate

Created pod: e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

openshift-ingress

deployment-controller

e2e-shared-a-w4-8b6cd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-8b6cd6-openshift-default-744b88677 from 1 to 2

openshift-ingress

multus

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a6873b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-a6873b-openshift-default-d47989c65

SuccessfulCreate

Created pod: e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-a6873b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a6873b-openshift-default-d47989c65 from 1 to 2
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-036c69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-036c69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-mt-2babaef6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2babaef6-openshift-default-6858cf4d9c from 0 to 1

openshift-ingress

multus

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-2babaef6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2babaef6

openshift-ingress

replicaset-controller

e2e-mt-2babaef6-openshift-default-6858cf4d9c

SuccessfulCreate

Created pod: e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2babaef6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2babaef6-67968898fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2babaef6: serviceaccount "payload-processing-e2e-mt-2babaef6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2babaef6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2babaef6-5c67ccc847 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2babaef6-67968898fc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2babaef6-67968898fc-kvt29
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2babaef6-67968898fc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2babaef6-67968898fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2babaef6: serviceaccount "payload-processing-e2e-mt-2babaef6" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulDelete

Deleted pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bgt6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

multus

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-57d281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-57d281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57d281-566d7fb6c-jbk6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-57d281-55d489b495-lvrd9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Unhealthy

Readiness probe failed: Get "http://10.132.0.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

ProbeError

Readiness probe error: Get "http://10.132.0.205:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-57d281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-57d281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Unhealthy

Startup probe failed: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

ProbeError

Startup probe error: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2babaef6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2babaef6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-82e760

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-82e760

openshift-ingress

deployment-controller

e2e-noten-82e760-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-82e760-openshift-default-5f697579fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-82e760-openshift-default-5f697579fc

SuccessfulCreate

Created pod: e2e-noten-82e760-openshift-default-5f697579fc-579fp

openshift-ingress

kubelet

e2e-noten-82e760-openshift-default-5f697579fc-579fp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-82e760-openshift-default-5f697579fc-579fp

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-82e760-openshift-default-5f697579fc-579fp

Started

Container started

openshift-ingress

kubelet

e2e-noten-82e760-openshift-default-5f697579fc-579fp

Created

Container created

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-57d281-openshift-default-697dd4cd45-xdq2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2babaef6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-2babaef6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-82e760-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-82e760-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-82e760-openshift-default-5f697579fc-579fp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

(combined from similar events): New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-t2j78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-29b57c-openshift-default-594b494869

SuccessfulDelete

Deleted pod: e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

openshift-ingress

deployment-controller

e2e-extmod-a-29b57c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-29b57c-openshift-default-594b494869 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-h8v6x

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-aaea41-openshift-default-67cb954d5-hfs2l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x8)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6f810f-5574bd88cf-297hs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6f810f-6f84bb8b8c-68hwv

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

openshift-ingress

replicaset-controller

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc

SuccessfulCreate

Created pod: e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e27ae7-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-e27ae7-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaea41-db75c5f57-kqfg4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaea41-54c4d9455-5cd64

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

multus

test-curl-7417-63c56c

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7417-63c56c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7417-63c56c

Created

Container created

opendatahub

kubelet

test-curl-7417-63c56c

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7417-63c56c

Killing

Stopping container test-curl-7417-63c56c

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-6f810f-openshift-default-5b8d58b9b9-bbjf6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-24b244

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-24b244

openshift-ingress

deployment-controller

e2e-extmod-a-24b244-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-24b244-openshift-default-6f9694767c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-24b244-openshift-default-6f9694767c

SuccessfulCreate

Created pod: e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

openshift-ingress

multus

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-24b244

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-24b244-749754f7d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-24b244: serviceaccount "payload-processing-e2e-extmod-a-24b244" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-24b244

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-24b244-56cb8b6df9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-24b244-56cb8b6df9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-24b244-56cb8b6df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-24b244: serviceaccount "payload-processing-e2e-extmod-a-24b244" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-24b244-56cb8b6df9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-kvt29

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-rt47l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e27ae7-7dc769584f-rrjx6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e27ae7-7c877fb66c-hglrt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77

SuccessfulCreate

Created pod: e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

openshift-ingress

deployment-controller

e2e-extmod-b-9ea5d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-9ea5d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-9ea5d2

openshift-ingress

multus

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9ea5d2: serviceaccount "payload-processing-e2e-extmod-b-9ea5d2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-9ea5d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9ea5d2: serviceaccount "payload-processing-e2e-extmod-b-9ea5d2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-9ea5d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2babaef6-67968898fc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2babaef6-67968898fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2babaef6: serviceaccount "payload-processing-e2e-mt-2babaef6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2babaef6: serviceaccount "payload-processing-e2e-mt-2babaef6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2babaef6-67968898fc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2babaef6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2babaef6-5c67ccc847 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2babaef6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2babaef6-67968898fc from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Unhealthy

Readiness probe failed: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

ProbeError

Readiness probe error: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-bsb6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-2vx4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-ts8nb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-9h52n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-pl7jl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-n9gw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-zrjrd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-l747w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-q8chm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e27ae7-openshift-default-74cd56c8bc-72kcm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-24b244-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-24b244-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-flhd5

Unhealthy

Readiness probe failed: Get "https://10.132.0.61:8000/ready": context deadline exceeded

opendatahub

multus

test-curl-7417-8514c7

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7417-8514c7

Started

Container started

opendatahub

kubelet

test-curl-7417-8514c7

Created

Container created

opendatahub

kubelet

test-curl-7417-8514c7

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulDelete

Deleted pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-9sgs2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4tbw6

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Unhealthy

Readiness probe failed: Get "http://10.133.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

kubelet

test-curl-7417-8514c7

Killing

Stopping container test-curl-7417-8514c7

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

ProbeError

Readiness probe error: Get "http://10.133.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-24b244-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-24b244-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-vsq9s

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulDelete

Deleted pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-z6grk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2babaef6-5c67ccc847-tnmtk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2babaef6-67968898fc-qnp8v

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9ea5d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9ea5d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-2babaef6-openshift-default-6858cf4d9c-4gcxb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulDelete

Deleted pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-pfcrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-24b244-openshift-default-6f9694767c-tsbjr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-24b244-749754f7d7-lpdhw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-24b244-56cb8b6df9-4vt6j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-mt-d2dc0ad5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d2dc0ad5

openshift-ingress

deployment-controller

e2e-mt-d2dc0ad5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d2dc0ad5-openshift-default-86bdfb9469 from 0 to 1

openshift-ingress

kubelet

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

Created

Container created

openshift-ingress

kubelet

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469

SuccessfulCreate

Created pod: e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

openshift-ingress

multus

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-9ea5d2-openshift-default-5cd6fcfc77-cqw4p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d2dc0ad5: serviceaccount "payload-processing-e2e-mt-d2dc0ad5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d2dc0ad5: serviceaccount "payload-processing-e2e-mt-d2dc0ad5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d2dc0ad5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d2dc0ad5-6fbb47f585 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d2dc0ad5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

openshift-ingress

kubelet

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9ea5d2-78b67f847f-j8dj9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9ea5d2-6c96fd4f45-lxrs4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d2dc0ad5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d2dc0ad5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9de2ac-6b849b9989-xmfwd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9de2ac-dcb8cdf67-hm9vf

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d2dc0ad5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d2dc0ad5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677

SuccessfulCreate

Created pod: e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

openshift-ingress

deployment-controller

e2e-shared-a-w4-8b6cd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-8b6cd6-openshift-default-744b88677 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-8b6cd6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

Created

Container created

openshift-ingress

multus

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-036c69-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w4-036c69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-036c69-openshift-default-8d6df548c from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w4-036c69-openshift-default-8d6df548c

SuccessfulCreate

Created pod: e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-6smnr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-9de2ac-openshift-default-5cccf5d68c-lt9ql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-036c69-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w4-036c69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-036c69-openshift-default-8d6df548c from 2 to 3

openshift-ingress

replicaset-controller

e2e-shared-b-w4-036c69-openshift-default-8d6df548c

SuccessfulCreate

Created pod: e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused

opendatahub

kubelet

test-curl-7426-341a04

Created

Container created

opendatahub

kubelet

test-curl-7426-341a04

Started

Container started

opendatahub

kubelet

test-curl-7426-341a04

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7426-341a04

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7426-ee9a91

Created

Container created

opendatahub

multus

test-curl-7426-ee9a91

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7426-ee9a91

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7426-ee9a91

Started

Container started

opendatahub

kubelet

test-curl-7426-341a04

Killing

Stopping container test-curl-7426-341a04

opendatahub

kubelet

test-curl-7426-ee9a91

Killing

Stopping container test-curl-7426-ee9a91

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-22g4n

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-22g4n

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

payload-processing-e2e-mt-d2dc0ad5-6fbb47f585-wtmzq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d2dc0ad5-96c44856c-pbt96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-bccce1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-bccce1-openshift-default-79b58b586f from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bccce1-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-bccce1-openshift-default-79b58b586f

SuccessfulDelete

Deleted pod: e2e-extmod-b-bccce1-openshift-default-79b58b586f-99z9d

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-7f2bs
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-3a6480-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-3a6480-openshift-default-cd95ffff7 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-3a6480-openshift-default-cd95ffff7

SuccessfulDelete

Deleted pod: e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-2j8w5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-3a6480-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-mt-d2dc0ad5-openshift-default-86bdfb9469-mgfvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-9be196-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-9be196-openshift-default-df667f8b9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-9be196-openshift-default-df667f8b9

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-9be196-openshift-default-df667f8b9-zbn7k

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-9be196-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-hwh5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

Killing

Stopping container payload-pre-processing
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-msx7k

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-msx7k

Pulled

Container image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-msx7k

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-ingress

deployment-controller

e2e-extmod-a-29b57c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-29b57c-openshift-default-594b494869 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-29b57c-openshift-default-594b494869

SuccessfulDelete

Deleted pod: e2e-extmod-a-29b57c-openshift-default-594b494869-7rmrc

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-29b57c-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

Killing

Stopping container payload-processing
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

deployment-controller

e2e-extmod-b-5370bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-5370bb-openshift-default-6f94db8cc from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-5370bb-openshift-default-6f94db8cc

SuccessfulDelete

Deleted pod: e2e-extmod-b-5370bb-openshift-default-6f94db8cc-njccw

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5370bb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

kuadrant-system

authorino-operator-7b7bb4bc77-msx7k_eabf12bd-e946-4f0c-8f9f-404bd80ee535

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-msx7k_eabf12bd-e946-4f0c-8f9f-404bd80ee535 became leader
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-3a6480-d6b5747dc-rdlxf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-3a6480-84cb444cf-2rlt6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-fhjdk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-ncdrr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-8b6cd6-openshift-default-744b88677-22jj2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-jz7fb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-dg96x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-3a6480-openshift-default-cd95ffff7-xbqfp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-8b6cd6-d9984647f-7jmjm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-8b6cd6-57c75d8679-zpmjj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-67jzd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-w726b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w4-036c69-openshift-default-8d6df548c-c8tnz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-a6873b-79b7f97879-9dhts

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-a6873b-79d848b447-zbs7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-29b57c-85958bc8ff-7zkd8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-036c69-79cd8c8b6f-fxpb5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-036c69-7d7b5cd59-5vqnt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w1-a6873b-openshift-default-d47989c65

SuccessfulCreate

Created pod: e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

openshift-ingress

deployment-controller

e2e-worker-w1-a6873b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-a6873b-openshift-default-d47989c65 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-a6873b-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-29b57c-openshift-default-594b494869-gc7f6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bccce1-5b9f8747f9-rvbs2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-29b57c-7b87bbfff-2nmvw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-bccce1-openshift-default-79b58b586f-gznb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-4d9r2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-qpz5v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-a6873b-openshift-default-d47989c65-xzckn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bccce1-f5ff9c447-whvwl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-9be196-openshift-default-df667f8b9-ngrfh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0aa61b-6b6c668b4f-qjlfd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0aa61b-5c479c87bc-jsktt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-0aa61b-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f from 3 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0aa61b-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f

SuccessfulCreate

Created pod: e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9be196-7cdb7588f5-lpfpq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9be196-6ddd5cdc-nsfp5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-e83b4b-openshift-default-944f5867f-5ncx8

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w4-0aa61b-openshift-default-dockercfg-bv7rw); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6xdbq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-z849s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w4-0aa61b-openshift-default-dockercfg-bv7rw); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-6jv6c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-4h9hd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0aa61b-openshift-default-677b6f9d9f-t979p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e83b4b-c7f9d755-nf2j8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-e38ef4-openshift-default-6b4dcb887c-6lcm4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e83b4b-557c8556cc-f742w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5370bb-648c6878bc-j99qx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e38ef4-64c649c7fc-p5cg7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e38ef4-66d56c5bcf-ng8cg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-5370bb-openshift-default-6f94db8cc-x4zz2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-main-1bfa0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-main-1bfa0e

openshift-ingress

replicaset-controller

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff

SuccessfulCreate

Created pod: e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

openshift-ingress

deployment-controller

e2e-worker-main-1bfa0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-main-1bfa0e-openshift-default-66f45d6dff from 0 to 1

openshift-ingress

multus

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-main-1bfa0e: serviceaccount "payload-processing-e2e-worker-main-1bfa0e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-main-1bfa0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5370bb-6c5d87878c-kng8d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-worker-main-1bfa0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-main-1bfa0e: serviceaccount "payload-processing-e2e-worker-main-1bfa0e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

openshift-ingress

multus

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-main-1bfa0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-main-1bfa0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fd4b99879-m6sln

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-fd4b99879 from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jmn77

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6sln

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fd4b99879-jmn77

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-8v5dc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-fd4b99879-8v5dc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-main-1bfa0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-main-1bfa0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

maas-controller-7f997f45fb-9tqcn

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-7f997f45fb

SuccessfulDelete

Deleted pod: maas-controller-7f997f45fb-9tqcn

opendatahub

multus

maas-controller-7f997f45fb-p4fgb

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7f997f45fb-p4fgb

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5"

opendatahub

replicaset-controller

maas-controller-7f997f45fb

SuccessfulCreate

Created pod: maas-controller-7f997f45fb-p4fgb

opendatahub

kubelet

maas-controller-7f997f45fb-p4fgb

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5" in 540ms (540ms including waiting). Image size: 200094740 bytes.

opendatahub

kubelet

maas-controller-7f997f45fb-p4fgb

Created

Container created

opendatahub

kubelet

maas-controller-7f997f45fb-p4fgb

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-main-1bfa0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-main-1bfa0e-openshift-default-66f45d6dff from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff

SuccessfulCreate

Created pod: e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-main-1bfa0e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Started

Container started

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

ProbeError

Startup probe error: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Unhealthy

Startup probe failed: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused

opendatahub

maas-controller-7f997f45fb-p4fgb_539401c1-0f5b-4216-9329-b5f759c8446c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7f997f45fb-p4fgb_539401c1-0f5b-4216-9329-b5f759c8446c became leader

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-989zh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-qzbgz

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-fd4b99879

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-fd4b99879-p6vnd

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-fd4b99879 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-qzbgz

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-989zh

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-fd4b99879-p6vnd

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

Unhealthy

Startup probe failed: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

ProbeError

Startup probe error: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

Unhealthy

Startup probe failed: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

ProbeError

Startup probe error: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused body:

opendatahub

replicaset-controller

maas-controller-7f997f45fb

SuccessfulDelete

Deleted pod: maas-controller-7f997f45fb-p4fgb
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7f997f45fb from 1 to 0

opendatahub

kubelet

maas-controller-7f997f45fb-p4fgb

Killing

Stopping container manager

opendatahub

kubelet

maas-controller-7f997f45fb-p4fgb

Unhealthy

Readiness probe failed: Get "http://10.132.0.252:8081/readyz": dial tcp 10.132.0.252:8081: connect: connection refused
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7f997f45fb from 0 to 1

opendatahub

replicaset-controller

maas-controller-7f997f45fb

SuccessfulCreate

Created pod: maas-controller-7f997f45fb-2rd9z

opendatahub

kubelet

maas-controller-7f997f45fb-2rd9z

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5"

opendatahub

kubelet

maas-controller-7f997f45fb-2rd9z

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:17456ac697946e22cb981722433b20feff75ff220346c6422395cd8a9d971db5" in 379ms (379ms including waiting). Image size: 200094740 bytes.

opendatahub

multus

maas-controller-7f997f45fb-2rd9z

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7f997f45fb-2rd9z

Created

Container created

opendatahub

kubelet

maas-controller-7f997f45fb-2rd9z

Started

Container started

opendatahub

maas-controller-7f997f45fb-2rd9z_2b81cda2-d19b-4fa3-a0f7-6748ca24e066

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7f997f45fb-2rd9z_2b81cda2-d19b-4fa3-a0f7-6748ca24e066 became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-59thg

Killing

Stopping container manager

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-59thg
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-dvwgc

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-dvwgc

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-dvwgc

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-dvwgc

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-dvwgc

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-dvwgc_5fbedda7-c2bf-455c-bfbb-c512318fc977

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-dvwgc_5fbedda7-c2bf-455c-bfbb-c512318fc977 became leader

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-b2vf7

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

Unhealthy

Readiness probe failed: Get "http://10.132.0.112:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b2vf7

ProbeError

Readiness probe error: Get "http://10.132.0.112:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-bnsdt

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-worker-main-1bfa0e-54bdfb5cb5-bbjkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-main-1bfa0e-778b5ffcff-xrldj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-main-1bfa0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-main-1bfa0e-openshift-default-66f45d6dff from 2 to 3

openshift-ingress

multus

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

Started

Container started

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-main-1bfa0e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff

SuccessfulCreate

Created pod: e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb
(x3)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-zstld

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-r9mtb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-022966d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-022966d4

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-main-1bfa0e-openshift-default-66f45d6dff-phl9b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ait-022966d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-022966d4-openshift-default-7795c9cf4c from 0 to 1

openshift-ingress

multus

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-022966d4-openshift-default-7795c9cf4c

SuccessfulCreate

Created pod: e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-022966d4-76857785ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-022966d4-76857785ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-022966d4-76857785ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-022966d4: serviceaccount "payload-processing-e2e-ait-022966d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-022966d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-022966d4-76857785ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-022966d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-022966d4-977867645 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-022966d4-977867645

FailedCreate

Error creating: pods "payload-processing-e2e-ait-022966d4-977867645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-022966d4: serviceaccount "payload-processing-e2e-ait-022966d4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-022966d4-977867645

SuccessfulCreate

Created pod: payload-processing-e2e-ait-022966d4-977867645-x62z2

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-022966d4-977867645-x62z2

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-022966d4-977867645-x62z2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-022966d4-977867645-x62z2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-022966d4-977867645-x62z2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-022966d4-977867645-x62z2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-022966d4-76857785ff-tjttg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-022966d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-022966d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-022966d4-openshift-default-7795c9cf4c-fvzzz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

ProbeError

Readiness probe error: Get "http://10.134.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-989zh

Unhealthy

Readiness probe failed: Get "http://10.134.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-d88cdf6dc

FailedCreate

Error creating: pods "payload-processing-external-model-d88cdf6dc-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-d88cdf6dc

SuccessfulCreate

Created pod: payload-processing-external-model-d88cdf6dc-hn82d

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d88cdf6dc from 0 to 1

models-as-a-service

multus

payload-processing-external-model-d88cdf6dc-hn82d

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-d88cdf6dc-hn82d

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-d88cdf6dc-hn82d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-d88cdf6dc-hn82d

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-d88cdf6dc-hn82d

Killing

Stopping container payload-processing

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.Secret llm/e2e-prio-pool-4cb35ada-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.Role llm/e2e-prio-pool-4cb35ada-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.ServiceAccount llm/e2e-prio-pool-4cb35ada-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.Service llm/e2e-prio-pool-4cb35ada-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.Deployment llm/e2e-prio-pool-4cb35ada-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-4cb35ada-epp-auth-rb

llm

deployment-controller

e2e-prio-pool-4cb35ada-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-4cb35ada-kserve-5855f876c6 from 0 to 1

llm

replicaset-controller

e2e-prio-pool-4cb35ada-kserve-5855f876c6

SuccessfulCreate

Created pod: e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

llm

replicaset-controller

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c

SuccessfulCreate

Created pod: e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

llm

deployment-controller

e2e-prio-pool-4cb35ada-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.Service llm/e2e-prio-pool-4cb35ada-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.RoleBinding llm/e2e-prio-pool-4cb35ada-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

Created v1.Deployment llm/e2e-prio-pool-4cb35ada-kserve-router-scheduler

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

llm

multus

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

Created

Container created

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

Started

Container started

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Updated

Updated v1.Secret llm/e2e-prio-pool-4cb35ada-kserve-self-signed-certs
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-4cb35ada-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 2.426s (2.426s including waiting). Image size: 184206420 bytes.

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Created

Container created

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Started

Container started

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-4cb35ada-kserve-route

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-4cb35ada] is Ready

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Killing

Stopping container main

llm

LLMInferenceServiceController

e2e-prio-pool-4cb35ada

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-4cb35ada-epp-auth-rb

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-5855f876c6-knm8k

Killing

Stopping container main

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-0d5ad972-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.HTTPRoute llm/e2e-same-id-a-0d5ad972-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.Secret llm/e2e-same-id-a-0d5ad972-kserve-self-signed-certs

llm

deployment-controller

e2e-same-id-a-0d5ad972-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-0d5ad972-kserve-55f9555c5c from 0 to 1

llm

replicaset-controller

e2e-same-id-a-0d5ad972-kserve-55f9555c5c

SuccessfulCreate

Created pod: e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.PodMonitor llm/e2e-same-id-a-0d5ad972-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.Deployment llm/e2e-same-id-a-0d5ad972-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.PodMonitor llm/e2e-same-id-a-0d5ad972-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.DestinationRule llm/e2e-same-id-a-0d5ad972-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Created

Created v1.Service llm/e2e-same-id-a-0d5ad972-kserve-workload-svc

llm

kubelet

e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

Created

Container created

llm

multus

e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

Updated

Updated v1.Secret llm/e2e-same-id-a-0d5ad972-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-0d5ad972] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.HTTPRoute llm/e2e-same-id-b-0d5ad972-kserve-route

llm

replicaset-controller

e2e-same-id-b-0d5ad972-kserve-76df95df97

SuccessfulCreate

Created pod: e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

llm

deployment-controller

e2e-same-id-b-0d5ad972-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-0d5ad972-kserve-76df95df97 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.Secret llm/e2e-same-id-b-0d5ad972-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.Deployment llm/e2e-same-id-b-0d5ad972-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.Service llm/e2e-same-id-b-0d5ad972-kserve-workload-svc

llm

multus

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.PodMonitor llm/e2e-same-id-b-0d5ad972-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.PodMonitor llm/e2e-same-id-b-0d5ad972-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.DestinationRule llm/e2e-same-id-b-0d5ad972-kserve-workload-svc

llm

kubelet

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-0d5ad972-prometheus-scraping

llm

kubelet

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

Updated

Updated v1.Secret llm/e2e-same-id-b-0d5ad972-kserve-self-signed-certs
(x5)

llm

kubelet

e2e-prio-pool-4cb35ada-kserve-router-scheduler-7b96567c4c-8n5mf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-0d5ad972] is Ready
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-0d5ad972

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-0d5ad972 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-0d5ad972; safe to ignore if traffic splitting is planned
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-0d5ad972

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-0d5ad972 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-0d5ad972; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-0d5ad972-kserve-55f9555c5c-s9xdj

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-0d5ad972-kserve-76df95df97-qfktp

Unhealthy

Readiness probe failed: Get "https://10.134.0.198:8000/ready": dial tcp 10.134.0.198:8000: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.22:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-ljtcq

ProbeError

Readiness probe error: Get "http://10.133.0.22:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-ipp-a-c268d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c268d1-openshift-default-76b6566dbc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-c268d1-openshift-default-76b6566dbc

SuccessfulCreate

Created pod: e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

openshift-ingress

multus

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c268d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c268d1

openshift-ingress

multus

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c268d1: serviceaccount "payload-processing-e2e-ipp-a-c268d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c268d1: serviceaccount "payload-processing-e2e-ipp-a-c268d1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c268d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c268d1-8688f99855 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c268d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Unhealthy

Readiness probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

ProbeError

Readiness probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-8688f99855-nhshz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-6b88fc9bbf-rtgvq

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c268d1-dd475596b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c268d1-dd475596b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c268d1: serviceaccount "payload-processing-e2e-ipp-a-c268d1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c268d1-76998665f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c268d1-76998665f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c268d1: serviceaccount "payload-processing-e2e-ipp-a-c268d1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c268d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c268d1-76998665f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c268d1-76998665f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c268d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c268d1-dd475596b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

AddedInterface

Add eth0 [10.132.1.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c268d1-dd475596b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

AddedInterface

Add eth0 [10.132.1.29/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.01s (2.01s including waiting). Image size: 166620835 bytes.
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.998s (1.998s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c268d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c268d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-a97e34-openshift-default-949f9f895

SuccessfulCreate

Created pod: e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a97e34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a97e34

openshift-ingress

deployment-controller

e2e-ipp-b-a97e34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a97e34-openshift-default-949f9f895 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a97e34: serviceaccount "payload-processing-e2e-ipp-b-a97e34" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a97e34: serviceaccount "payload-processing-e2e-ipp-b-a97e34" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a97e34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a97e34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a97e34-6fbc9fc65 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c268d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c268d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-6fbc9fc65-hz65n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

ProbeError

Readiness probe error: Get "http://10.134.0.203:15021/healthz/ready": read tcp 10.134.0.2:38920->10.134.0.203:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Unhealthy

Readiness probe failed: Get "http://10.134.0.203:15021/healthz/ready": read tcp 10.134.0.2:38920->10.134.0.203:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-54c9b6ff9f-9cjv2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a97e34: serviceaccount "payload-processing-e2e-ipp-b-a97e34" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a97e34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a97e34: serviceaccount "payload-processing-e2e-ipp-b-a97e34" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a97e34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq

AddedInterface

Add eth0 [10.132.1.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

AddedInterface

Add eth0 [10.132.1.31/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a97e34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a97e34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c268d1-76998665f-f725h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c268d1-dd475596b-z9s9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-c268d1-openshift-default-76b6566dbc-qggsl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a97e34-b6b9dc6b6-6rptr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a97e34-758556cc6c-f77mq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-978cf677d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-978cf677d

SuccessfulCreate

Created pod: payload-pre-processing-978cf677d-rwtqn

openshift-ingress

multus

payload-pre-processing-978cf677d-rwtqn

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-978cf677d-rwtqn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-978cf677d-rwtqn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-978cf677d-rwtqn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-a97e34-openshift-default-949f9f895-r72hs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-wwqfh

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-wwqfh

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-68b4f896d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-68b4f896d

SuccessfulCreate

Created pod: payload-processing-68b4f896d-pxw6w

openshift-ingress

kubelet

payload-processing-68b4f896d-pxw6w

Created

Container created

openshift-ingress

multus

payload-processing-68b4f896d-pxw6w

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-68b4f896d-pxw6w

Started

Container started

openshift-ingress

kubelet

payload-processing-68b4f896d-pxw6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-r5wf2

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r5wf2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-5ff9ddc8d7

SuccessfulCreate

Created pod: payload-processing-5ff9ddc8d7-c89gd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5ff9ddc8d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7f75799d9b-w7752

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-7f75799d9b-w7752

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5ff9ddc8d7-c89gd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7f75799d9b-w7752

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7f75799d9b-w7752

Started

Container started

openshift-ingress

kubelet

payload-processing-5ff9ddc8d7-c89gd

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-7f75799d9b

SuccessfulCreate

Created pod: payload-pre-processing-7f75799d9b-w7752

openshift-ingress

multus

payload-processing-5ff9ddc8d7-c89gd

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7f75799d9b from 0 to 1

openshift-ingress

kubelet

payload-processing-5ff9ddc8d7-c89gd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-68b4f896d

SuccessfulDelete

Deleted pod: payload-processing-68b4f896d-pxw6w

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-978cf677d from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-978cf677d-rwtqn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-68b4f896d-pxw6w

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-978cf677d

SuccessfulDelete

Deleted pod: payload-pre-processing-978cf677d-rwtqn

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-68b4f896d from 1 to 0
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-9gj26

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-9gj26

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5bcd7997-9gj26

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-9gj26

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-9gj26

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-9gj26

Killing

Stopping container payload-processing
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-fl2rn

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-m6qv8

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-s4pct

ProbeError

Readiness probe error: Get "http://10.134.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

Unhealthy

Readiness probe failed: Get "http://10.134.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-jsxtq

ProbeError

Readiness probe error: Get "http://10.134.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-single-main-4e9e72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77

SuccessfulCreate

Created pod: e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-4e9e72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-4e9e72

openshift-ingress

multus

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4e9e72-d776d5967

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-4e9e72-d776d5967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4e9e72: serviceaccount "payload-processing-e2e-worker-single-main-4e9e72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4e9e72-d776d5967

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-4e9e72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-4e9e72-d776d5967 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-4e9e72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4e9e72: serviceaccount "payload-processing-e2e-worker-single-main-4e9e72" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

Unhealthy

Startup probe failed: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

ProbeError

Startup probe error: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-4e9e72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-4e9e72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-4e9e72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-4e9e72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967dhxq2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784fsqwl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-4e9e72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-4e9e72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-4e9e72-d776d5967 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4e9e72: serviceaccount "payload-processing-e2e-worker-single-main-4e9e72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4e9e72-d776d5967

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-4e9e72-d776d5967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-4e9e72: serviceaccount "payload-processing-e2e-worker-single-main-4e9e72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-4e9e72-d776d5967

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-4e9e72-56784b7675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-4e9e72-d776d5967rfj57

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-4e9e72-56784nkvms

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-4e9e72-openshift-default-fb6f65d77-rjnxr

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

ProbeError

Readiness probe error: Get "http://10.134.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

Unhealthy

Readiness probe failed: Get "http://10.132.1.0:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-qzbgz

ProbeError

Readiness probe error: Get "http://10.132.1.0:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

Unhealthy

Readiness probe failed: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-p6vnd

ProbeError

Readiness probe error: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-fd4b99879-c6qrt

Unhealthy

Readiness probe failed: Get "http://10.134.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rrr99

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rrr99

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rrr99

Pulled

Container image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-9hf26

BackOff

Back-off restarting failed container manager in pod dns-operator-controller-manager-8557cbdb84-9hf26_kuadrant-system(64f36934-c791-4d4a-b443-81e23ecb97ac)
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

limitador-operator-controller-manager-5778bb4449-rrr99_ecbae5c9-dcab-4f18-ac5f-8459b8b70131

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-rrr99_ecbae5c9-dcab-4f18-ac5f-8459b8b70131 became leader
(x3)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-9hf26

Created

Container created
(x3)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-9hf26

Started

Container started
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-9hf26

Pulled

Container image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

dns-operator-controller-manager-8557cbdb84-9hf26_e23dfe44-d04e-424d-89cb-b1a7f9ea3eb4

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-9hf26_e23dfe44-d04e-424d-89cb-b1a7f9ea3eb4 became leader