Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6 to ip-10-0-133-217.us-east-2.compute.internal

ai-tenants

e2e-api-a-54df68

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-54df68: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-7406a9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-7406a9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-80f70e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-80f70e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-47369d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-47369d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-65e5ec

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-65e5ec: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-a2d8e5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-a2d8e5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-eed369

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-eed369: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-ffdea6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-ffdea6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-4248ae

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-4248ae: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-84e377

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-84e377: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-027c19

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-027c19: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-7c759a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-7c759a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-821f5a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-821f5a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-d25759

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d25759: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-ddd653

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-ddd653: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-3c5983

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-3c5983: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-57079b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-57079b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-af8244

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-af8244: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-be59df

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-be59df: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-e1f08d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-e1f08d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-4b17ac

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-4b17ac: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-6fec8a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-6fec8a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-a88862

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-a88862: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-b6afd6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-b6afd6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-ee618c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-ee618c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-5bfc51

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-5bfc51: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-5dab6a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-5dab6a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-b4971a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-b4971a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-ce04af

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-ce04af: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-07f5f6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-07f5f6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-7f43f9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-7f43f9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-dc0f3f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-dc0f3f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-f88f87

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-f88f87: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-02e4c0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-02e4c0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-db5422

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-db5422: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-def754

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-def754: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-ff4113

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-ff4113: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-737bf2d8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-737bf2d8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-dd03e395

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-dd03e395: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-1e352e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-1e352e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-b9dad7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-b9dad7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-d5f78f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-d5f78f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-208a0d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-208a0d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-46510c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-46510c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-f14bda

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-f14bda: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-50e623

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-50e623: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-2729f2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-2729f2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-531447

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-531447: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-717217

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-717217: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-6c0ec0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-6c0ec0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-020af9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-020af9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-4af1f7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-4af1f7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-ef434a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-ef434a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-556c14

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-556c14: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-4a697f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-4a697f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-2f9a3a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-2f9a3a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-88bbf7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-88bbf7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-f7680d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-f7680d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-83755a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-83755a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-650be0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-650be0: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-j5b6p

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-j5b6p to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-jbfv6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-jbfv6 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2 to ip-10-0-133-217.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-b2m52

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-b2m52 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gw8mh to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jkd9f to ip-10-0-140-107.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-ktz44

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-ktz44 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-jvqst

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jvqst to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mktb8 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-594b68584c-jw4kg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-594b68584c-jw4kg to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8 to ip-10-0-140-107.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-v7m2q

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-v7m2q to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-594b68584c-km4bh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-594b68584c-km4bh to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Scheduled

Successfully assigned openshift-ingress/e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6644c85865gxcxg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6644c85865gxcxg to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub-operator-system

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7cc9488979-jh6tz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv to ip-10-0-140-107.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-l2ztx

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-l2ztx to ip-10-0-133-217.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7cc9488979-bj5xx to ip-10-0-133-217.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7cc9488979-9nqbf to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-46hnd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-46hnd to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-zzws2

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zzws2 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh to ip-10-0-133-217.us-east-2.compute.internal

kuadrant-system

authorino-597cdd5495-wq4hg

Scheduled

Successfully assigned kuadrant-system/authorino-597cdd5495-wq4hg to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr to ip-10-0-133-217.us-east-2.compute.internal

kuadrant-system

authorino-5fcd47cd5b-rwf6t

Scheduled

Successfully assigned kuadrant-system/authorino-5fcd47cd5b-rwf6t to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc to ip-10-0-136-112.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-bsh8j

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-bsh8j to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

authorino-6f6944bcdd-sdt5p

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-sdt5p to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr to ip-10-0-140-107.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-c9svn

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-c9svn to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

test-curl-7037-98d1a5

Scheduled

Successfully assigned opendatahub/test-curl-7037-98d1a5 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-54df68-59cb67b865-9d886

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-54df68-59cb67b865-9d886 to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

test-curl-7037-279bc9

Scheduled

Successfully assigned opendatahub/test-curl-7037-279bc9 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk to ip-10-0-133-217.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-sw79f

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-sw79f to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

test-curl-7037-1655dd

Scheduled

Successfully assigned opendatahub/test-curl-7037-1655dd to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z to ip-10-0-140-107.us-east-2.compute.internal

opendatahub

test-curl-7034-aaa247

Scheduled

Successfully assigned opendatahub/test-curl-7034-aaa247 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a88862-6bccb6967f-46486 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5 to ip-10-0-140-107.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-4222l

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-4222l to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-7kxj4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-7kxj4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv to ip-10-0-133-217.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7zsk9

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7zsk9 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-9jvbb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

test-curl-7034-3d9226

Scheduled

Successfully assigned opendatahub/test-curl-7034-3d9226 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-a88862-openshift-default-7b98d598f-bt5vt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-btqdp

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btqdp to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-a88862-openshift-default-7b98d598f-bt5vt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm to ip-10-0-140-107.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f5v7z to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk to ip-10-0-140-107.us-east-2.compute.internal

opendatahub

test-curl-7031-b93ad0

Scheduled

Successfully assigned opendatahub/test-curl-7031-b93ad0 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-80f70e-openshift-default-5984948b65-ck87x to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-9xvbs to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5 to ip-10-0-133-217.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-thg2j

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-thg2j to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc to ip-10-0-140-107.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-4pw7v

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-4pw7v to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-szqjl

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-szqjl to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

test-curl-7028-f5c007

Scheduled

Successfully assigned opendatahub/test-curl-7028-f5c007 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

test-curl-7028-d89cda

Scheduled

Successfully assigned opendatahub/test-curl-7028-d89cda to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc to ip-10-0-140-107.us-east-2.compute.internal

opendatahub

test-curl-7028-86b699

Scheduled

Successfully assigned opendatahub/test-curl-7028-86b699 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f to ip-10-0-140-107.us-east-2.compute.internal

opendatahub

test-curl-7028-0c2035

Scheduled

Successfully assigned opendatahub/test-curl-7028-0c2035 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z to ip-10-0-140-107.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4 to ip-10-0-133-217.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-tmxmj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287 to ip-10-0-140-107.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-fp9vz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

Scheduled

Successfully assigned llm/e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh to ip-10-0-133-217.us-east-2.compute.internal

llm

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Scheduled

Successfully assigned llm/e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5 to ip-10-0-140-107.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-ctxbc

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-ctxbc to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-d852p

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-d852p to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-fjz5c to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

Scheduled

Successfully assigned openshift-ingress/e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Scheduled

Successfully assigned openshift-ingress/e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-kr275

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-kr275 to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-knbqk

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-knbqk to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-l9ccf to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-lsz2g

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5 to ip-10-0-140-107.us-east-2.compute.internal

llm

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

Scheduled

Successfully assigned llm/e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-lsz2g

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq to ip-10-0-133-217.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-s6gsn

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-s6gsn to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k to ip-10-0-140-107.us-east-2.compute.internal

llm

e2e-same-id-a-077b6796

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-077b6796

llm

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

Scheduled

Successfully assigned llm/e2e-same-id-b-077b6796-kserve-58584d646f-45vkg to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-jobset-operator

jobset-controller-manager-6f98fffc9c-l2ptp

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-6f98fffc9c-l2ptp to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-lsz2g to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-q8qhz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6 to ip-10-0-140-107.us-east-2.compute.internal

opendatahub

maas-controller-7b85f9594f-xg8nb

Scheduled

Successfully assigned opendatahub/maas-controller-7b85f9594f-xg8nb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

router-default-d7798ccf5-442kt

Scheduled

Successfully assigned openshift-ingress/router-default-d7798ccf5-442kt to ip-10-0-140-107.us-east-2.compute.internal

llm

e2e-same-id-b-077b6796

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-077b6796

llm

e2e-same-id-b-077b6796

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-lc7tp to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb to ip-10-0-133-217.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-5dqn2

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-5dqn2 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-gswcf

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-gswcf

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub

test-curl-7034-65817a

Scheduled

Successfully assigned opendatahub/test-curl-7034-65817a to ip-10-0-140-107.us-east-2.compute.internal

ai-tenants

e2e-api-a-51119c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-51119c: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-6q4gn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-6q4gn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-5f985d8646-z5mcb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-5f985d8646-z5mcb to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-q8qhz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-tt72j

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-tt72j

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-59b8dd6b64-jcv9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59b8dd6b64-jcv9p to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

maas-controller-7b85f9594f-vwbsl

Scheduled

Successfully assigned opendatahub/maas-controller-7b85f9594f-vwbsl to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-pcw82

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-pcw82 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd to ip-10-0-133-217.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-ptjsj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-ptjsj to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

maas-controller-7b85f9594f-9gw68

Scheduled

Successfully assigned opendatahub/maas-controller-7b85f9594f-9gw68 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-q5n9x to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wg7jh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wg7jh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs to ip-10-0-140-107.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5774fbf4b9-pl5dw

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5774fbf4b9-pl5dw to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6 to ip-10-0-140-107.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-59dbb77fb8-5h2hn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-59dbb77fb8-5h2hn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw to ip-10-0-133-217.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-59dbb77fb8-grz4z

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-59dbb77fb8-grz4z to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-r2cgw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-r2cgw to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg to ip-10-0-133-217.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5bcd7997-m85fl

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-m85fl to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

router-default-d7798ccf5-442kt

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-d7798ccf5-442kt

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7 to ip-10-0-136-112.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-67757c7bbc-7lndz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-67757c7bbc-7lndz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-7c759a-openshift-default-56576554df-2k9wb

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b to ip-10-0-136-112.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6889df475b-4kdg9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6889df475b-4kdg9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx to ip-10-0-140-107.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6889df475b-r2899

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6889df475b-r2899 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt to ip-10-0-133-217.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6b5656f4df-j7686

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b5656f4df-j7686 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh to ip-10-0-133-217.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-76c77f5454-5cg5j

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-76c77f5454-5cg5j to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-4248ae-85686d5965-jxtv4 to ip-10-0-133-217.us-east-2.compute.internal

ai-tenants

e2e-api-a-340b96

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-340b96: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7 to ip-10-0-133-217.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-76c77f5454-842p6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-76c77f5454-842p6 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d to ip-10-0-140-107.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-76c77f5454-kqvq2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-76c77f5454-kqvq2 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ffdea6-6975889bf-cb625 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2 to ip-10-0-136-112.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-858d96bddf-mjhfr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-858d96bddf-mjhfr to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-dd03e395-b8464b49-p8872 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5d8dddb676-9fw7q

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-9fw7q to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-7c759a-openshift-default-56576554df-2k9wb

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-s4dc8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-s4dc8 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-qvj7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-qvj7w to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2 to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

ai-gateway-controller-75bbf6968c-fz65x

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-75bbf6968c-fz65x to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-754bb5cbcf-77zpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-754bb5cbcf-77zpm to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-76c78d77d6-zpncn

Scheduled

Successfully assigned openshift-ingress/payload-processing-76c78d77d6-zpncn to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

opendatahub

kserve-controller-manager-776cc66d47-mpgsb

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-mpgsb to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47 to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-n922j

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-n922j to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-eed369-openshift-default-66698bcb95-pknkp to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-skx44

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-skx44 to ip-10-0-136-112.us-east-2.compute.internal

opendatahub

maas-controller-59fd54f5bc-lqb6l

Scheduled

Successfully assigned opendatahub/maas-controller-59fd54f5bc-lqb6l to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-t5bt4 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-def754-openshift-default-544466b787-9msx9 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-kkdsj

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-kkdsj to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-340b96-c984ff695-nz2kt to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs to ip-10-0-133-217.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-t9tw2

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-t9tw2 to ip-10-0-136-112.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-vm5w5 to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9 to ip-10-0-133-217.us-east-2.compute.internal

openshift-ingress

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-596dc9545f-v5p6s to ip-10-0-140-107.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-d7798ccf5 from 0 to 1

openshift-ingress

replicaset-controller

router-default-d7798ccf5

SuccessfulCreate

Created pod: router-default-d7798ccf5-442kt

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-d7798ccf5-442kt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-d7798ccf5-442kt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-d7798ccf5-442kt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-d7798ccf5-442kt

Started

Container started

openshift-ingress

multus

router-default-d7798ccf5-442kt

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-d7798ccf5-442kt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-d7798ccf5-442kt

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-jbfv6

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-jbfv6

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.031s (3.031s including waiting). Image size: 185476477 bytes.

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-5cb6869599

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-skx44

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-5cb6869599 from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-skx44

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.211s (9.211s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.903s (9.903s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5cb6869599-sfh7n

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-7cc9488979 from 0 to 3

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7cc9488979

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7cc9488979-bj5xx

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7cc9488979-jh6tz

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7cc9488979

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7cc9488979-9nqbf

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7cc9488979

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7cc9488979-jh6tz

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7cc9488979-9nqbf

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7cc9488979-bj5xx

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.899s (2.899s including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Started

Container started
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-7cc9488979-bj5xx_d8314130-2ed9-4486-a64a-a5723af05dd5

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-7cc9488979-bj5xx_d8314130-2ed9-4486-a64a-a5723af05dd5 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-bj5xx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 559ms (559ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-s6gsn

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: waiting for spec update of deployment "jobset-operator" to be observed...
(x3)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-s6gsn

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-s6gsn

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-x78hd

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 7.912s (7.912s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 7.939s (7.939s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-s6gsn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-s6gsn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 414ms (414ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-s6gsn

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.401s (2.401s including waiting). Image size: 224874686 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-9nqbf

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-s6gsn_5a925190-1024-4c98-adfb-f1b25c8d054d became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 460ms (460ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7cc9488979-jh6tz

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-f5v7z

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-ktz44

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-ktz44

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ktz44

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

multus

authorino-operator-7b7bb4bc77-c9svn

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-c9svn

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c9svn

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.646s (4.646s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

Created

Container created

kuadrant-system

authorino-operator-7b7bb4bc77-c9svn_eb8e247a-8bbb-41a1-968c-782013b795ac

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-c9svn_eb8e247a-8bbb-41a1-968c-782013b795ac became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c9svn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.703s (1.703s including waiting). Image size: 167738465 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-f5v7z_252eafe0-249c-4abb-bfd5-c6c98a194a2f

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-f5v7z_252eafe0-249c-4abb-bfd5-c6c98a194a2f became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c9svn

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-c9svn

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ktz44

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.796s (3.796s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ktz44

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ktz44

Started

Container started

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-szqjl

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-szqjl

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-4222l

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-4222l

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-4222l

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-szqjl

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-b2m52

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-b2m52

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-b2m52

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-b2m52

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-b2m52

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-j5b6p

kuadrant-system

limitador-operator-controller-manager-5778bb4449-szqjl_462f525e-938b-4ffd-85f2-2daa4431ecdc

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-szqjl_462f525e-938b-4ffd-85f2-2daa4431ecdc became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-szqjl

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-szqjl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.214s (2.214s including waiting). Image size: 177967631 bytes.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-szqjl

Started

Container started

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-sw79f

cert-manager

kubelet

cert-manager-597b95cb84-j5b6p

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

multus

cert-manager-597b95cb84-j5b6p

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-sw79f

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

cert-manager

kubelet

cert-manager-597b95cb84-j5b6p

Started

Container started

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-sw79f

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-j5b6p

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-4222l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.275s (5.275s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-4222l

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-sw79f

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.297s (2.297s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-4222l

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-sw79f_d3e77c8b-e6e2-4ad1-8b89-87bcfd26db06

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-sw79f_d3e77c8b-e6e2-4ad1-8b89-87bcfd26db06 became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7zsk9

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7zsk9

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7zsk9

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7zsk9

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7zsk9

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-594b68584c from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-594b68584c

SuccessfulCreate

Created pod: kube-auth-proxy-594b68584c-km4bh

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6644c85865 from 0 to 1

openshift-ingress

replicaset-controller

kube-auth-proxy-594b68584c

SuccessfulCreate

Created pod: kube-auth-proxy-594b68584c-jw4kg

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6644c85865

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6644c85865gxcxg

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6644c85865gxcxg

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-jw4kg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6644c85865gxcxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6644c85865gxcxg

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6644c85865gxcxg

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

multus

kube-auth-proxy-594b68584c-jw4kg

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-km4bh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

multus

kube-auth-proxy-594b68584c-km4bh

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-v7m2q

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-n922j

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-l2ztx

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-km4bh

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-km4bh

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-v7m2q

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-l2ztx

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-l2ztx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-v7m2q

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-km4bh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.545s (2.545s including waiting). Image size: 188904677 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-n922j

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-n922j

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-jw4kg

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-jw4kg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.676s (2.676s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-594b68584c-jw4kg

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-n922j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.548s (2.548s including waiting). Image size: 195729000 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-l2ztx

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-n922j

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-l2ztx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.658s (3.658s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-l2ztx

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-v7m2q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.202s (3.202s including waiting). Image size: 204096810 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-n922j

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-v7m2q

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-v7m2q

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-l2ztx

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-l2ztx

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-f5v7z

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-f5v7z

Killing

Stopping container manager

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-t92fc"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-7swxc"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-6f98fffc9c-l2ptp

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-6f98fffc9c-l2ptp

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-6f98fffc9c

SuccessfulCreate

Created pod: jobset-controller-manager-6f98fffc9c-l2ptp

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-6f98fffc9c from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionUpdated

Updated CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it changed

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-thg2j

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

kubelet

jobset-controller-manager-6f98fffc9c-l2ptp

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.596s (4.596s including waiting). Image size: 182184678 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thg2j

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-thg2j

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-jobset-operator

jobset-controller-manager-6f98fffc9c-l2ptp_17b6f771-09ac-4655-9dca-bf3485c5e92c

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-6f98fffc9c-l2ptp_17b6f771-09ac-4655-9dca-bf3485c5e92c became leader

opendatahub

kserve-module-controller-manager-7566cf5fc8-n922j_f7e6c011-1948-4121-b4d7-d2efdf9aa256

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-n922j_f7e6c011-1948-4121-b4d7-d2efdf9aa256 became leader

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thg2j

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thg2j

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thg2j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.044s (2.044s including waiting). Image size: 133379307 bytes.

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7zsk9_dd80970d-f610-48eb-8d0d-6438a3496061

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7zsk9_dd80970d-f610-48eb-8d0d-6438a3496061 became leader

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-4pw7v

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

multus

limitador-limitador-7c9b87d574-4pw7v

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4pw7v

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4pw7v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.83s (2.83s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4pw7v

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4pw7v

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-thg2j

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thg2j

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:8080/status": dial tcp 10.133.0.41:8080: connect: connection refused

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-thg2j

Killing

Stopping container limitador

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-jkd9f

opendatahub

kubelet

odh-model-controller-769875db56-ctxbc

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-knbqk

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-t9tw2

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t9tw2

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-ctxbc

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-mpgsb

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-t9tw2

opendatahub

multus

kserve-controller-manager-776cc66d47-mpgsb

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-knbqk

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

model-serving-api-75bd89fdfc-knbqk

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

opendatahub

multus

odh-model-controller-769875db56-ctxbc

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jkd9f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jbfv6

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-jbfv6

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-knbqk

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-knbqk

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-knbqk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.883s (2.883s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-ctxbc

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-ctxbc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.079s (4.079s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-ctxbc

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t9tw2

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t9tw2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.478s (3.478s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t9tw2

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mpgsb

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.651s (3.651s including waiting). Image size: 247676581 bytes.

opendatahub

llmisvc-controller-manager-869d5dcc5d-t9tw2_1e8214ae-63cd-4a60-8b78-40e111a460e3

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-t9tw2_1e8214ae-63cd-4a60-8b78-40e111a460e3 became leader

opendatahub

kserve-controller-manager-776cc66d47-mpgsb_4cf1a281-7096-4f86-abf7-d6240279d69f

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-mpgsb_4cf1a281-7096-4f86-abf7-d6240279d69f became leader

opendatahub

odh-model-controller-769875db56-ctxbc_70d52cb7-bb4d-4d3e-b57f-01ac535b4fe8

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-ctxbc_70d52cb7-bb4d-4d3e-b57f-01ac535b4fe8 became leader

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-59fd54f5bc from 0 to 1

opendatahub

replicaset-controller

maas-controller-59fd54f5bc

SuccessfulCreate

Created pod: maas-controller-59fd54f5bc-lqb6l

opendatahub

multus

maas-controller-59fd54f5bc-lqb6l

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-59fd54f5bc-lqb6l

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da"

opendatahub

replicaset-controller

maas-controller-7b85f9594f

SuccessfulCreate

Created pod: maas-controller-7b85f9594f-9gw68

opendatahub

kubelet

maas-controller-7b85f9594f-9gw68

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da"

opendatahub

multus

maas-controller-7b85f9594f-9gw68

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-59fd54f5bc-lqb6l

Created

Container created

opendatahub

kubelet

maas-controller-7b85f9594f-9gw68

Started

Container started

opendatahub

kubelet

maas-controller-7b85f9594f-9gw68

Created

Container created

opendatahub

kubelet

maas-controller-59fd54f5bc-lqb6l

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da" in 3.185s (3.185s including waiting). Image size: 200104981 bytes.

opendatahub

kubelet

maas-controller-59fd54f5bc-lqb6l

Started

Container started

opendatahub

kubelet

maas-controller-7b85f9594f-9gw68

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da" in 2.785s (2.785s including waiting). Image size: 200104981 bytes.

opendatahub

maas-controller-59fd54f5bc-lqb6l_4931f1fb-86d8-47d0-b285-ff8c12c37dde

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-59fd54f5bc-lqb6l_4931f1fb-86d8-47d0-b285-ff8c12c37dde became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzws2

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-zzws2

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-zzws2

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-59fd54f5bc from 1 to 0

opendatahub

replicaset-controller

maas-controller-59fd54f5bc

SuccessfulDelete

Deleted pod: maas-controller-59fd54f5bc-lqb6l

opendatahub

kubelet

maas-controller-59fd54f5bc-lqb6l

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzws2

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzws2

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-zzws2

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 15.557s (15.557s including waiting). Image size: 1089502687 bytes.
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-7b85f9594f-9gw68_8c294076-790e-4c79-8df3-f2bdbf29bceb

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7b85f9594f-9gw68_8c294076-790e-4c79-8df3-f2bdbf29bceb became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

ProbeError

Readiness probe error: Get "http://10.133.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Unhealthy

Readiness probe failed: Get "http://10.133.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-5fcd47cd5b from 0 to 1

kuadrant-system

kubelet

authorino-6889cbd8c4-bsh8j

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-bsh8j
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Created

Container created

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-sdt5p
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Started

Container started

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-sdt5p

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-bsh8j

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-5fcd47cd5b

SuccessfulCreate

Created pod: authorino-5fcd47cd5b-rwf6t

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

multus

authorino-6889cbd8c4-bsh8j

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5fcd47cd5b-rwf6t

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 589ms (589ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-bsh8j

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6889cbd8c4-bsh8j

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-bsh8j

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-bsh8j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 818ms (818ms including waiting). Image size: 204096810 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

authorino-5fcd47cd5b-rwf6t

Started

Container started

kuadrant-system

kubelet

authorino-5fcd47cd5b-rwf6t

Created

Container created

kuadrant-system

kubelet

authorino-5fcd47cd5b-rwf6t

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-5fcd47cd5b-rwf6t

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-v7m2q

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-v7m2q

Killing

Stopping container authorino

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-kkdsj

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-kkdsj

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kkdsj

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kkdsj

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kkdsj

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kkdsj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 773ms (773ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-t9tw2

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t9tw2

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-9fw7q

opendatahub

multus

ai-gateway-controller-5d8dddb676-9fw7q

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-9fw7q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-9fw7q

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-9fw7q

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-9fw7q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.012s (2.012s including waiting). Image size: 183979430 bytes.

opendatahub

ai-gateway-controller-5d8dddb676-9fw7q_44403d97-a083-4d19-a105-6e2852e34761

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-9fw7q_44403d97-a083-4d19-a105-6e2852e34761 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-qvj7w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-6q4gn

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6q4gn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-qvj7w

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-qvj7w

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-6q4gn

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-qvj7w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.383s (2.383s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-qvj7w

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-qvj7w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6q4gn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.41s (2.41s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6q4gn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6q4gn

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-75bbf6968c from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-75bbf6968c

SuccessfulCreate

Created pod: ai-gateway-controller-75bbf6968c-fz65x

opendatahub

multus

ai-gateway-controller-75bbf6968c-fz65x

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-75bbf6968c-fz65x

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-75bbf6968c-fz65x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 394ms (394ms including waiting). Image size: 183979430 bytes.

opendatahub

kubelet

ai-gateway-controller-75bbf6968c-fz65x

Created

Container created

opendatahub

kubelet

ai-gateway-controller-75bbf6968c-fz65x

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-kkdsj_85ad963e-3e6f-4eb9-a733-9cdddef320bc

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-kkdsj_85ad963e-3e6f-4eb9-a733-9cdddef320bc became leader

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-9fw7q

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-9fw7q

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kksqt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.373s (1.373s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.263s (1.263s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

Created

Container created

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 278ms (278ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-fp9vz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

opendatahub

ai-gateway-controller-75bbf6968c-fz65x_8372805b-5b4b-4853-8449-d53a8341ce55

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-75bbf6968c-fz65x_8372805b-5b4b-4853-8449-d53a8341ce55 became leader

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 297ms (297ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-lc7tp

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 308ms (308ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

multus

echo-simulator-kserve-64b6f8f96c-5dqn2

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5dqn2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-5dqn2

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5dqn2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.732s (1.732s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5dqn2

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5dqn2

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 315ms (315ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-xggrt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 283ms (283ms including waiting). Image size: 98346788 bytes.

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 1 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-9jvbb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-q5n9x

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-9jvbb

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-q5n9x

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.073s (3.073s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.575s (3.575s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

kuadrant-system

replicaset-controller

authorino-597cdd5495

SuccessfulCreate

Created pod: authorino-597cdd5495-wq4hg

kuadrant-system

multus

authorino-597cdd5495-wq4hg

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-597cdd5495-wq4hg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-597cdd5495-wq4hg

Started

Container started

kuadrant-system

kubelet

authorino-597cdd5495-wq4hg

Created

Container created

kuadrant-system

kubelet

authorino-597cdd5495-wq4hg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 866ms (866ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-5fcd47cd5b from 1 to 0

kuadrant-system

kubelet

authorino-5fcd47cd5b-rwf6t

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-5fcd47cd5b

SuccessfulDelete

Deleted pod: authorino-5fcd47cd5b-rwf6t
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-d852p

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-s4dc8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-pcw82

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 3 to 6

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-pcw82

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-s4dc8

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-d852p

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-l9ccf

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-t5bt4

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-t5bt4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-l9ccf

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-331bcaa1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-331bcaa1-openshift-default-86476dcd55 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-15abbf02-openshift-default-65d8997ff

SuccessfulCreate

Created pod: e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

openshift-ingress

gateway_labeler_controller

e2e-migrate-e9b9924e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e9b9924e-gw

openshift-ingress

deployment-controller

e2e-migrate-e9b9924e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df

SuccessfulCreate

Created pod: e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

openshift-ingress

deployment-controller

e2e-ait-15abbf02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-15abbf02-openshift-default-65d8997ff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-331bcaa1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-331bcaa1

openshift-ingress

replicaset-controller

e2e-ait-331bcaa1-openshift-default-86476dcd55

SuccessfulCreate

Created pod: e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

openshift-ingress

multus

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-15abbf02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-15abbf02

openshift-ingress

gateway_labeler_controller

e2e-ait-c83251ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c83251ee

openshift-ingress

multus

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-c83251ee-openshift-default-5567cd685c

SuccessfulCreate

Created pod: e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

openshift-ingress

deployment-controller

e2e-ait-c83251ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c83251ee-openshift-default-5567cd685c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e9b9924e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e9b9924e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e9b9924e-79d64d74c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

openshift-ingress

kubelet

payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-331bcaa1-846ff86f65

FailedCreate

Error creating: pods "payload-processing-e2e-ait-331bcaa1-846ff86f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-331bcaa1: serviceaccount "payload-processing-e2e-ait-331bcaa1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-331bcaa1-589958875f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-331bcaa1-589958875f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-331bcaa1: serviceaccount "payload-processing-e2e-ait-331bcaa1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-331bcaa1-589958875f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-331bcaa1-846ff86f65

SuccessfulCreate

Created pod: payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-331bcaa1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-331bcaa1-589958875f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-331bcaa1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-331bcaa1-846ff86f65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e9b9924e-79d64d74c5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e9b9924e-79d64d74c5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e9b9924e-79d64d74c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e9b9924e: serviceaccount "payload-processing-e2e-migrate-e9b9924e" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e9b9924e: serviceaccount "payload-processing-e2e-migrate-e9b9924e" not found

openshift-ingress

multus

payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-15abbf02-85bb978ffc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-15abbf02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-15abbf02-85bb978ffc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

openshift-ingress

multus

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-15abbf02: serviceaccount "payload-processing-e2e-ait-15abbf02" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-15abbf02-85bb978ffc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-15abbf02-85bb978ffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-15abbf02: serviceaccount "payload-processing-e2e-ait-15abbf02" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-15abbf02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c83251ee-9b676fc95

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c83251ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c83251ee-78c8c48447 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c83251ee-9b676fc95

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c83251ee-9b676fc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c83251ee: serviceaccount "payload-processing-e2e-ait-c83251ee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c83251ee-78c8c48447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c83251ee-78c8c48447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c83251ee-78c8c48447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c83251ee: serviceaccount "payload-processing-e2e-ait-c83251ee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c83251ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c83251ee-9b676fc95 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-derive-4aec6006

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4aec6006

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.745s (3.745s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.884s (3.884s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

Created

Container created

openshift-ingress

replicaset-controller

e2e-derive-4aec6006-openshift-default-77f675f877

SuccessfulCreate

Created pod: e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

Created

Container created

openshift-ingress

deployment-controller

e2e-derive-4aec6006-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4aec6006-openshift-default-77f675f877 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.536s (3.536s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.884s (1.884s including waiting). Image size: 125353963 bytes.

openshift-ingress

multus

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.099s (2.099s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4aec6006-75dd64d785

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4aec6006-75dd64d785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4aec6006: serviceaccount "payload-processing-e2e-derive-4aec6006" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4aec6006-75dd64d785

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4aec6006

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4aec6006-75dd64d785 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4aec6006

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4aec6006: serviceaccount "payload-processing-e2e-derive-4aec6006" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15abbf02-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15abbf02-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-331bcaa1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-331bcaa1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c83251ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c83251ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": read tcp 10.132.0.2:45084->10.132.0.45:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": read tcp 10.132.0.2:45084->10.132.0.45:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4aec6006-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4aec6006-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-331bcaa1-589958875f-gsq9q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-331bcaa1-846ff86f65-qqczq

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15abbf02-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15abbf02-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-e9b9924e-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-e9b9924e-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-331bcaa1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-331bcaa1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c83251ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c83251ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-15abbf02-85bb978ffc-q9krm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15abbf02-6fbdf5668c-r7klb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-331bcaa1-openshift-default-86476dcd55-7z4mx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-e9b9924e-79d64d74c5-r6l2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e9b9924e-5646b597cf-cgg6n

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-650be0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-650be0

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-c83251ee-9b676fc95-cpf7t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c83251ee-78c8c48447-h8glz

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-e9b9924e-gw-openshift-default-58b595c4df-xtlrf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-f7680d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-f7680d
(x2)

openshift-ingress

kubelet

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-83755a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-83755a

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-c83251ee-openshift-default-5567cd685c-69vg9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

Created

Container created

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-650be0-86d95657b7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-650be0-86d95657b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-650be0: serviceaccount "payload-processing-e2e-worker-w4-650be0" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4aec6006-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-650be0-86d95657b7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-650be0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-2f9a3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-2f9a3a

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-650be0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-650be0-86d95657b7 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-650be0: serviceaccount "payload-processing-e2e-worker-w4-650be0" not found

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4aec6006-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

Started

Container started

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-15abbf02-openshift-default-65d8997ff-dtl78

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-f7680d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-f7680d-59ddf48c45 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-4aec6006-75dd64d785-ndfg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4aec6006-5b7d45d8d7-9jwv2

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-f7680d: serviceaccount "payload-processing-e2e-worker-w2-f7680d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-f7680d-59ddf48c45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-f7680d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-f7680d-59ddf48c45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-f7680d-59ddf48c45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-f7680d: serviceaccount "payload-processing-e2e-worker-w2-f7680d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-83755a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-83755a-67c54f67f5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-83755a: serviceaccount "payload-processing-e2e-worker-w3-83755a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-83755a-67c54f67f5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-83755a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-83755a-67c54f67f5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-83755a-67c54f67f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-83755a: serviceaccount "payload-processing-e2e-worker-w3-83755a" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-derive-4aec6006-openshift-default-77f675f877-fjbkq

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2f9a3a: serviceaccount "payload-processing-e2e-worker-w0-2f9a3a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-2f9a3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2f9a3a-8697684787

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-2f9a3a-8697684787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2f9a3a: serviceaccount "payload-processing-e2e-worker-w0-2f9a3a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-2f9a3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-2f9a3a-8697684787 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2f9a3a-8697684787

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-88bbf7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-88bbf7

openshift-ingress

multus

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-88bbf7-78b86696f9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-88bbf7-78b86696f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-88bbf7: serviceaccount "payload-processing-e2e-worker-w1-88bbf7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-88bbf7: serviceaccount "payload-processing-e2e-worker-w1-88bbf7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-88bbf7-78b86696f9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-88bbf7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-88bbf7-78b86696f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-88bbf7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:54500->10.134.0.53:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:54500->10.134.0.53:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-6889df475b

FailedCreate

Error creating: pods "payload-processing-external-model-6889df475b-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-6889df475b

SuccessfulCreate

Created pod: payload-processing-external-model-6889df475b-4kdg9
(x5)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-6889df475b-4kdg9

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-4kdg9

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-4kdg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-4kdg9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Created

Container created

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-596dc9545f-v5p6s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-9xvbs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-9xvbs

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-v5p6s

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b5656f4df from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6b5656f4df

SuccessfulCreate

Created pod: payload-processing-external-model-6b5656f4df-j7686
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-6b5656f4df-j7686

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6b5656f4df-j7686

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6b5656f4df-j7686

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6b5656f4df-j7686

Started

Container started
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-6889df475b

SuccessfulDelete

Deleted pod: payload-processing-external-model-6889df475b-4kdg9

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-4kdg9

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6889df475b from 1 to 0

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Created

Container created

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Created

Container created

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Created

Container created

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

Created

Container created

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

Started

Container started

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 4 to 6

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-gw8mh

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

models-as-a-service

replicaset-controller

payload-processing-external-model-6889df475b

SuccessfulCreate

Created pod: payload-processing-external-model-6889df475b-r2899
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6889df475b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-r2899

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6889df475b-r2899

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-r2899

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-r2899

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.572s (3.572s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6889df475b-r2899

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6b5656f4df-j7686

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Created

Container created

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 6 to 9

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

Created

Container created

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

Created

Container created

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

Created

Container created

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Created

Container created

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Started

Container started

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

llm

kubelet

echo-simulator-kserve-64b6f8f96c-5dqn2

Unhealthy

Readiness probe failed: Get "https://10.134.0.33:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-mt-dd03e395

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-dd03e395

openshift-ingress

deployment-controller

e2e-mt-dd03e395-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-dd03e395-openshift-default-75799f6fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-dd03e395-openshift-default-75799f6fc

SuccessfulCreate

Created pod: e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

openshift-ingress

multus

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dd03e395-b8464b49

SuccessfulCreate

Created pod: payload-processing-e2e-mt-dd03e395-b8464b49-p8872

openshift-ingress

deployment-controller

payload-processing-e2e-mt-dd03e395

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-dd03e395-b8464b49 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dd03e395-779465d96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-dd03e395-779465d96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dd03e395: serviceaccount "payload-processing-e2e-mt-dd03e395" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dd03e395-779465d96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dd03e395-b8464b49

FailedCreate

Error creating: pods "payload-processing-e2e-mt-dd03e395-b8464b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dd03e395: serviceaccount "payload-processing-e2e-mt-dd03e395" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-dd03e395

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-dd03e395-779465d96c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 4 to 6

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

Started

Container started

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Created

Container created

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-dd03e395-openshift-default-75799f6fc

SuccessfulCreate

Created pod: e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-dd03e395-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-dd03e395-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-dd03e395-openshift-default-75799f6fc from 1 to 2

openshift-ingress

multus

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-51119c-openshift-default-56b69d85d9

SuccessfulCreate

Created pod: e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

openshift-ingress

deployment-controller

e2e-api-a-51119c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-51119c-openshift-default-56b69d85d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-51119c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-51119c

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Started

Container started

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Created

Container created

openshift-ingress

multus

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Unhealthy

Readiness probe failed: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

ProbeError

Readiness probe error: Get "http://10.134.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-51119c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-51119c-546967fcc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-51119c-546967fcc9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-51119c-546967fcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-51119c: serviceaccount "payload-processing-e2e-api-a-51119c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-51119c-7988b955f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-51119c-7988b955f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-51119c: serviceaccount "payload-processing-e2e-api-a-51119c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-51119c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-51119c-7988b955f5 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-51119c-7988b955f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-51119c-546967fcc9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

openshift-ingress

multus

payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Created

Container created

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-dd03e395-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-dd03e395-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-api-b-65e5ec-openshift-default-84ff8668f

SuccessfulCreate

Created pod: e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

openshift-ingress

gateway_labeler_controller

e2e-api-b-65e5ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-65e5ec

openshift-ingress

deployment-controller

e2e-api-b-65e5ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-65e5ec-openshift-default-84ff8668f from 0 to 1

openshift-ingress

multus

e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

Created

Container created

openshift-ingress

kubelet

e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-dd03e395-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-dd03e395-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-65e5ec-64858685d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-65e5ec-64858685d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-65e5ec-64858685d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-65e5ec: serviceaccount "payload-processing-e2e-api-b-65e5ec" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-65e5ec: serviceaccount "payload-processing-e2e-api-b-65e5ec" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-65e5ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-65e5ec-5f46866b59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-65e5ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-65e5ec-64858685d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-65e5ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-65e5ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-65e5ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-65e5ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-51119c-7988b955f5-kr9rl

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

payload-processing-e2e-api-a-51119c-546967fcc9-mtcnh

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-mktb8

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-mktb8

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-51119c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-51119c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.738s (3.738s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-51119c-openshift-default-56b69d85d9-ds9fq

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7034-65817a

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7034-65817a

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7034-65817a

Created

Container created

opendatahub

kubelet

test-curl-7034-65817a

Started

Container started

opendatahub

kubelet

test-curl-7034-65817a

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.12s (3.12s including waiting). Image size: 106100986 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-65e5ec-64858685d7-dt99f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-65e5ec-5f46866b59-knkfz

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-54df68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-54df68

openshift-ingress

replicaset-controller

e2e-api-a-54df68-openshift-default-74b6dbc6cf

SuccessfulCreate

Created pod: e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

openshift-ingress

deployment-controller

e2e-api-a-54df68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-54df68-openshift-default-74b6dbc6cf from 0 to 1

openshift-ingress

multus

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7034-65817a

Killing

Stopping container test-curl-7034-65817a
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-54df68-5d998485f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-54df68-5d998485f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-54df68: serviceaccount "payload-processing-e2e-api-a-54df68" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-54df68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-54df68-59cb67b865 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-54df68-59cb67b865

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-54df68-59cb67b865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-54df68: serviceaccount "payload-processing-e2e-api-a-54df68" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-54df68-5d998485f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-54df68-59cb67b865

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-54df68-59cb67b865-9d886

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-54df68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-54df68-5d998485f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-54df68-59cb67b865-9d886

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-54df68-59cb67b865-9d886

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-54df68-59cb67b865-9d886

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-54df68-59cb67b865-9d886

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

Started

Container started

openshift-ingress

kubelet

e2e-api-b-65e5ec-openshift-default-84ff8668f-kjxr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-api-b-a2d8e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a2d8e5-openshift-default-85655d8485 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-a2d8e5-openshift-default-85655d8485

SuccessfulCreate

Created pod: e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

openshift-ingress

gateway_labeler_controller

e2e-api-b-a2d8e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a2d8e5

openshift-ingress

multus

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a2d8e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a2d8e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a2d8e5-5bb4464ff9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a2d8e5: serviceaccount "payload-processing-e2e-api-b-a2d8e5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a2d8e5: serviceaccount "payload-processing-e2e-api-b-a2d8e5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-54df68-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-54df68-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-p8872

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-tckp6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dd03e395-b8464b49

SuccessfulCreate

Created pod: payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

openshift-ingress

deployment-controller

e2e-api-a-340b96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-340b96-openshift-default-7846d978b9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-dd03e395

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-dd03e395-b8464b49 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dd03e395-779465d96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-dd03e395-779465d96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dd03e395: serviceaccount "payload-processing-e2e-mt-dd03e395" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dd03e395-779465d96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-dd03e395

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-dd03e395-779465d96c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dd03e395-b8464b49

FailedCreate

Error creating: pods "payload-processing-e2e-mt-dd03e395-b8464b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dd03e395: serviceaccount "payload-processing-e2e-mt-dd03e395" not found

openshift-ingress

gateway_labeler_controller

e2e-api-a-340b96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-340b96

openshift-ingress

replicaset-controller

e2e-api-a-340b96-openshift-default-7846d978b9

SuccessfulCreate

Created pod: e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

Started

Container started

openshift-ingress

multus

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-340b96-86744887cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-340b96-86744887cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-340b96: serviceaccount "payload-processing-e2e-api-a-340b96" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-340b96-86744887cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-340b96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-340b96-86744887cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-340b96-c984ff695

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-340b96-c984ff695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-340b96: serviceaccount "payload-processing-e2e-api-a-340b96" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-340b96-c984ff695

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-340b96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-340b96-c984ff695 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2d8e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2d8e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2d8e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a2d8e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-54df68-59cb67b865-9d886

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-eed369

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-eed369

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54df68-5d998485f9-pknfz

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-api-b-eed369-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-eed369-openshift-default-66698bcb95 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-eed369-openshift-default-66698bcb95

SuccessfulCreate

Created pod: e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

openshift-ingress

multus

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-54df68-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-54df68-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

multus

test-curl-7034-3d9226

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7034-3d9226

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7034-3d9226

Started

Container started

opendatahub

kubelet

test-curl-7034-3d9226

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-07f5f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-07f5f6

openshift-ingress

deployment-controller

e2e-ipp-a-07f5f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-07f5f6-openshift-default-98746c89f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-07f5f6-openshift-default-98746c89f

SuccessfulCreate

Created pod: e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

openshift-ingress

multus

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7034-3d9226

Killing

Stopping container test-curl-7034-3d9226

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-eed369-688b4d87b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-eed369-688b4d87b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-eed369: serviceaccount "payload-processing-e2e-api-b-eed369" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-eed369-7d94fb8545

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-eed369-7d94fb8545

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-eed369-7d94fb8545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-eed369: serviceaccount "payload-processing-e2e-api-b-eed369" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-eed369

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-eed369-7d94fb8545 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-eed369-688b4d87b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-eed369

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-eed369-688b4d87b7 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Unhealthy

Readiness probe failed: Get "http://10.134.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

ProbeError

Readiness probe error: Get "http://10.134.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-07f5f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-07f5f6-f97497957 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-07f5f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-07f5f6-f97497957

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-07f5f6-f97497957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-07f5f6: serviceaccount "payload-processing-e2e-ipp-a-07f5f6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-07f5f6-f97497957

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-07f5f6: serviceaccount "payload-processing-e2e-ipp-a-07f5f6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-54df68-openshift-default-74b6dbc6cf-4kmpk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a2d8e5-f6bfcf94c-4jbsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a2d8e5-5bb4464ff9-fpt8c

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Unhealthy

Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

ProbeError

Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-a2d8e5-openshift-default-dockercfg-prbqw); attempting to pull the image may not succeed.

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7f43f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7f43f9

openshift-ingress

deployment-controller

e2e-ipp-a-7f43f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7f43f9-openshift-default-74496bd585 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-a2d8e5-openshift-default-85655d8485-f4q8h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-7f43f9-openshift-default-74496bd585

SuccessfulCreate

Created pod: e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

openshift-ingress

multus

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7f43f9: serviceaccount "payload-processing-e2e-ipp-a-7f43f9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7f43f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7f43f9-59dc7465d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7f43f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7f43f9: serviceaccount "payload-processing-e2e-ipp-a-7f43f9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-a-80f70e-openshift-default-5984948b65

SuccessfulCreate

Created pod: e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

openshift-ingress

gateway_labeler_controller

e2e-api-a-80f70e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-80f70e

openshift-ingress

deployment-controller

e2e-api-a-80f70e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-80f70e-openshift-default-5984948b65 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

Started

Container started

openshift-ingress

multus

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-78d57d48ff-tgdfc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-f97497957-m28k9

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-340b96-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-80f70e-bfc75b495

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-80f70e-bfc75b495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-80f70e: serviceaccount "payload-processing-e2e-api-a-80f70e" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-340b96-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-80f70e-fb5785db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-80f70e-fb5785db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-80f70e: serviceaccount "payload-processing-e2e-api-a-80f70e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-80f70e-fb5785db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-80f70e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-80f70e-fb5785db7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-80f70e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-80f70e-bfc75b495 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-80f70e-bfc75b495

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

openshift-ingress

multus

payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-340b96-c984ff695-nz2kt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-340b96-86744887cf-swn7k

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-07f5f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-07f5f6: serviceaccount "payload-processing-e2e-ipp-a-07f5f6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-07f5f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-07f5f6-6448498d8b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-07f5f6-6448498d8b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-07f5f6-6448498d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-07f5f6: serviceaccount "payload-processing-e2e-ipp-a-07f5f6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-07f5f6-6448498d8b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.635s (2.636s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.895s (2.895s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-69b998759f-zzpgn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-59dc7465d7-dnsxs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dd03e395-b8464b49-7rlqj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dd03e395-779465d96c-nppw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-340b96-openshift-default-7846d978b9-8zqfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

ProbeError

Readiness probe error: Get "http://10.134.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Unhealthy

Readiness probe failed: Get "http://10.134.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Created

Container created

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-7406a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7406a9-openshift-default-74c9f8d955 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-eed369-7d94fb8545-hdldv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eed369-688b4d87b7-wdrsx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7f43f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7f43f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7f43f9-56467b6944 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-7406a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7406a9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7f43f9-56467b6944

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7f43f9-56467b6944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7f43f9: serviceaccount "payload-processing-e2e-ipp-a-7f43f9" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7f43f9: serviceaccount "payload-processing-e2e-ipp-a-7f43f9" not found

openshift-ingress

replicaset-controller

e2e-api-a-7406a9-openshift-default-74c9f8d955

SuccessfulCreate

Created pod: e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7f43f9-56467b6944

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

openshift-ingress

multus

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-4gdnp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-47369d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-47369d-openshift-default-696ccdd997 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-80f70e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-47369d-openshift-default-696ccdd997

SuccessfulCreate

Created pod: e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

openshift-ingress

gateway_labeler_controller

e2e-api-b-47369d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-47369d

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-eed369-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-eed369-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-80f70e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

ProbeError

Startup probe error: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Unhealthy

Startup probe failed: Get "http://10.134.0.129:15021/healthz/ready": dial tcp 10.134.0.129:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-db5422

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-db5422

openshift-ingress

multus

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-db5422-openshift-default-696cf4dc99

SuccessfulCreate

Created pod: e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

openshift-ingress

deployment-controller

e2e-ipp-b-db5422-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-db5422-openshift-default-696cf4dc99 from 0 to 1

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-dd03e395-openshift-default-75799f6fc-kx54z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

Started

Container started

openshift-ingress

multus

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7406a9-78cc96967f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7406a9-5cd77855fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7406a9-5cd77855fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7406a9: serviceaccount "payload-processing-e2e-api-a-7406a9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7406a9-78cc96967f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7406a9-78cc96967f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7406a9: serviceaccount "payload-processing-e2e-api-a-7406a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7406a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7406a9-78cc96967f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7406a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7406a9-5cd77855fc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7406a9-5cd77855fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-07f5f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-07f5f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-47369d: serviceaccount "payload-processing-e2e-api-b-47369d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-47369d-7c8f86b795

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-47369d-7c8f86b795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-47369d: serviceaccount "payload-processing-e2e-api-b-47369d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-47369d-7c8f86b795

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-47369d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-47369d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-47369d-7c8f86b795 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-db5422

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-db5422-68786bc84f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-db5422

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-db5422: serviceaccount "payload-processing-e2e-ipp-b-db5422" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-db5422-68786bc84f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-db5422-68786bc84f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-db5422-68786bc84f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-db5422: serviceaccount "payload-processing-e2e-ipp-b-db5422" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

ProbeError

Readiness probe error: Get "http://10.134.0.132:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Unhealthy

Readiness probe failed: Get "http://10.134.0.132:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-def754

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-def754

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-eed369-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-api-b-eed369-openshift-default" not found

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-b-def754-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-def754-openshift-default-544466b787 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-eed369-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-eed369-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-def754-openshift-default-544466b787

SuccessfulCreate

Created pod: e2e-ipp-b-def754-openshift-default-544466b787-9msx9
(x2)

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f88f87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f88f87

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-api-b-eed369-openshift-default-66698bcb95-pknkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885

SuccessfulCreate

Created pod: e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

openshift-ingress

deployment-controller

e2e-ipp-a-f88f87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f88f87-openshift-default-7b6c9d6885 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-07f5f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-07f5f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-def754-7788f9b985

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-def754-7788f9b985

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-def754-7788f9b985-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-def754: serviceaccount "payload-processing-e2e-ipp-b-def754" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-def754

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-def754-969c7dd8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-def754

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-def754-7788f9b985 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-def754: serviceaccount "payload-processing-e2e-ipp-b-def754" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f88f87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f88f87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f88f87-5c6d75c98c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f88f87: serviceaccount "payload-processing-e2e-ipp-a-f88f87" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f88f87: serviceaccount "payload-processing-e2e-ipp-a-f88f87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7406a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7406a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-ffdea6-openshift-default-85977f6bff

SuccessfulCreate

Created pod: e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

openshift-ingress

deployment-controller

e2e-api-b-ffdea6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ffdea6-openshift-default-85977f6bff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-ffdea6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ffdea6

openshift-ingress

multus

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7f43f9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ffdea6-6975889bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ffdea6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ffdea6-6975889bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ffdea6-67f595b459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ffdea6-67f595b459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ffdea6: serviceaccount "payload-processing-e2e-api-b-ffdea6" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7f43f9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ffdea6-67f595b459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ffdea6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ffdea6-67f595b459 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ffdea6-6975889bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ffdea6-6975889bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ffdea6: serviceaccount "payload-processing-e2e-api-b-ffdea6" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-80f70e-fb5785db7-l2v4s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-80f70e-bfc75b495-7qxcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-68786bc84f-9nclv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-5f7b97b655-4nwn5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-def754-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-def754-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-969c7dd8c-rb4dt

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-7788f9b985-ppxwb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-db5422

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-db5422-8464b57b74 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-db5422-8464b57b74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-db5422-8464b57b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-db5422: serviceaccount "payload-processing-e2e-ipp-b-db5422" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-db5422

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-db5422: serviceaccount "payload-processing-e2e-ipp-b-db5422" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-db5422-8464b57b74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-5d58f64779-pwc7n

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.146:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-5c6d75c98c-8cjnk

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.119:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-80f70e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-80f70e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-47369d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-47369d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-def754-555d7884c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-def754

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-def754-744dbd79f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-def754

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-def754-555d7884c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-def754-744dbd79f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-def754-744dbd79f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-def754: serviceaccount "payload-processing-e2e-ipp-b-def754" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-def754-744dbd79f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-def754-555d7884c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-def754-555d7884c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-def754: serviceaccount "payload-processing-e2e-ipp-b-def754" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f88f87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f88f87-7b579c8df6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f88f87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f88f87: serviceaccount "payload-processing-e2e-ipp-a-f88f87" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f88f87-7b579c8df6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f88f87-7b579c8df6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f88f87: serviceaccount "payload-processing-e2e-ipp-a-f88f87" not found

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

ProbeError

Readiness probe error: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f88f87-7b579c8df6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Unhealthy

Readiness probe failed: Get "http://10.134.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

ProbeError

Readiness probe error: Get "http://10.134.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Unhealthy

Readiness probe failed: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.578s (3.578s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-80f70e-openshift-default-5984948b65-ck87x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.546s (3.546s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-47369d-7c8f86b795-hclwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-47369d-6fbdd5b9b7-h78wk

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-47369d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-47369d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f88f87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-db5422-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f88f87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-db5422-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-7406a9-5cd77855fc-n4s94

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7406a9-78cc96967f-6wksw

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-vj4qt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-267h5

openshift-ingress

kubelet

e2e-api-b-47369d-openshift-default-696ccdd997-9mqtd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc

SuccessfulCreate

Created pod: e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1e352e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1e352e

openshift-ingress

deployment-controller

e2e-praxis-a-1e352e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc from 0 to 1

openshift-ingress

multus

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-02e4c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-02e4c0

openshift-ingress

replicaset-controller

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9

SuccessfulCreate

Created pod: e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

openshift-ingress

deployment-controller

e2e-ipp-b-02e4c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-02e4c0-openshift-default-c64cd65d9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1e352e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1e352e-585bf55c69

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1e352e: serviceaccount "payload-processing-e2e-praxis-a-1e352e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1e352e-585bf55c69

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1e352e-585bf55c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1e352e: serviceaccount "payload-processing-e2e-praxis-a-1e352e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1e352e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1e352e-585bf55c69 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

Started

Container started

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Unhealthy

Readiness probe failed: Get "http://10.132.0.112:15021/healthz/ready": read tcp 10.132.0.2:44864->10.132.0.112:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Started

Container started

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

ProbeError

Readiness probe error: Get "http://10.132.0.112:15021/healthz/ready": read tcp 10.132.0.2:44864->10.132.0.112:15021: read: connection reset by peer body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-02e4c0-7796479459

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-02e4c0-7796479459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-02e4c0: serviceaccount "payload-processing-e2e-ipp-b-02e4c0" not found
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-02e4c0: serviceaccount "payload-processing-e2e-ipp-b-02e4c0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-02e4c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-02e4c0-7796479459 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-02e4c0-7796479459

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-02e4c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ffdea6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ffdea6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

Started

Container started

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-a-7406a9-openshift-default-74c9f8d955-rqrs4

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-rwxw4

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-nzmzn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-j8q97

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7f43f9-79d79dfff5-kpcxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ph469

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7f43f9-56467b6944-h8nzs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ffdea6-67f595b459-k49vb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ffdea6-6975889bf-cb625

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-def754-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-def754-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f88f87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-db5422-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-db5422-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f88f87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ffdea6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ffdea6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-7f43f9-openshift-default-74496bd585-lp65l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc

SuccessfulCreate

Created pod: e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-dc0f3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-dc0f3f

openshift-ingress

deployment-controller

e2e-ipp-a-dc0f3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 10 to 9

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5nv8c

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-ffdea6-openshift-default-85977f6bff-jw7rs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-02e4c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-def754

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-def754: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-def754": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-def754, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 583bfc79-895b-4fd7-b5d0-46509908c7c7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-def754-744dbd79f-dm4jt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-def754-555d7884c4-k8sh9

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-02e4c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-208a0d-openshift-default-67457fb65c

SuccessfulCreate

Created pod: e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dc0f3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dc0f3f: serviceaccount "payload-processing-e2e-ipp-a-dc0f3f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-208a0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-208a0d

openshift-ingress

deployment-controller

e2e-praxis-b-208a0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-208a0d-openshift-default-67457fb65c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dc0f3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dc0f3f: serviceaccount "payload-processing-e2e-ipp-a-dc0f3f" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-7796479459-fjkx9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-57ff55f5cf-72j67

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-def754-openshift-default-544466b787-9msx9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

openshift-ingress

deployment-controller

e2e-praxis-a-d5f78f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d5f78f-openshift-default-64f48987d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-208a0d-6f7c665d67

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-208a0d-6f7c665d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-208a0d: serviceaccount "payload-processing-e2e-praxis-b-208a0d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-208a0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-208a0d-6f7c665d67 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-208a0d-6f7c665d67

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-208a0d: serviceaccount "payload-processing-e2e-praxis-b-208a0d" not found

openshift-ingress

replicaset-controller

e2e-praxis-a-d5f78f-openshift-default-64f48987d9

SuccessfulCreate

Created pod: e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-208a0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d5f78f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d5f78f

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-02e4c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 9 to 8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-02e4c0: serviceaccount "payload-processing-e2e-ipp-b-02e4c0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-02e4c0: serviceaccount "payload-processing-e2e-ipp-b-02e4c0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-02e4c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-fgwv5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d5f78f: serviceaccount "payload-processing-e2e-praxis-a-d5f78f" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d5f78f-d665ddc99

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d5f78f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d5f78f-d665ddc99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d5f78f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d5f78f-d665ddc99

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d5f78f-d665ddc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d5f78f: serviceaccount "payload-processing-e2e-praxis-a-d5f78f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-747fcc75fc-zvf8h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-5c746d84f9-4scbk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

ProbeError

Readiness probe error: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Unhealthy

Readiness probe failed: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dc0f3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dc0f3f: serviceaccount "payload-processing-e2e-ipp-a-dc0f3f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dc0f3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dc0f3f: serviceaccount "payload-processing-e2e-ipp-a-dc0f3f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f88f87-67d5f888b7-nf6wt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f88f87-7b579c8df6-qvh6t

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-46510c-openshift-default-849969b69c

SuccessfulCreate

Created pod: e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-46510c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-46510c
(x7)

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-praxis-b-46510c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-46510c-openshift-default-849969b69c from 0 to 1

openshift-ingress

multus

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f88f87-openshift-default-7b6c9d6885-g92w2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-208a0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-208a0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-46510c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-46510c-d675d977f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-46510c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-46510c-5cc495698c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-46510c-5cc495698c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-46510c-5cc495698c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-46510c-5cc495698c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-46510c: serviceaccount "payload-processing-e2e-praxis-b-46510c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-46510c-d675d977f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-46510c-d675d977f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-46510c-d675d977f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-46510c: serviceaccount "payload-processing-e2e-praxis-b-46510c" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-cmdm8

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-zrdp5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Unhealthy

Readiness probe failed: Get "http://10.134.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

ProbeError

Readiness probe error: Get "http://10.134.0.163:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f

SuccessfulCreate

Created pod: e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ff4113

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ff4113

openshift-ingress

deployment-controller

e2e-ipp-b-ff4113-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ff4113-openshift-default-6b94f7db5f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

ProbeError

Readiness probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Unhealthy

Readiness probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dc0f3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dc0f3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz
(x6)

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ff4113

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ff4113: serviceaccount "payload-processing-e2e-ipp-b-ff4113" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ff4113

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ff4113-7756b5c9bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ff4113: serviceaccount "payload-processing-e2e-ipp-b-ff4113" not found
(x6)

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-02e4c0-597548c69f-ccdnj

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-07f5f6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-07f5f6-openshift-default-98746c89f

SuccessfulCreate

Created pod: e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-07f5f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-07f5f6-openshift-default-98746c89f from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-02e4c0-68d4d67f9b-ncxlh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1e352e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1e352e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-46510c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-46510c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

ProbeError

Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

Unhealthy

Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-02e4c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-02e4c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-208a0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-208a0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-02e4c0-openshift-default-c64cd65d9-7l2h4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b9dad7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b9dad7

openshift-ingress

multus

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9

SuccessfulCreate

Created pod: e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

openshift-ingress

deployment-controller

e2e-praxis-a-b9dad7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b9dad7-openshift-default-994bfcbb9 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d5f78f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d5f78f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b9dad7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b9dad7-7458764995 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b9dad7-8569798f65

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b9dad7-8569798f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b9dad7: serviceaccount "payload-processing-e2e-praxis-a-b9dad7" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dc0f3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dc0f3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b9dad7: serviceaccount "payload-processing-e2e-praxis-a-b9dad7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b9dad7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b9dad7-8569798f65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b9dad7-8569798f65

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

openshift-ingress

multus

payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5f78f-6f874c67f9-llvzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-7756b5c9bf-9slj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-784c56fbc9-82ttz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5f78f-d665ddc99-pgdkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

ProbeError

Readiness probe error: Get "http://10.132.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Unhealthy

Readiness probe failed: Get "http://10.132.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ff4113

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ff4113-679c7cdbdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ff4113: serviceaccount "payload-processing-e2e-ipp-b-ff4113" not found

openshift-ingress

kubelet

e2e-praxis-a-d5f78f-openshift-default-64f48987d9-rk5hm

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ff4113: serviceaccount "payload-processing-e2e-ipp-b-ff4113" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ff4113

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ff4113-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ff4113-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

Unhealthy

Startup probe failed: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

ProbeError

Startup probe error: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-46510c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-46510c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-46510c-5cc495698c-94h2j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-46510c-d675d977f-ph287

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-07f5f6-6448498d8b-k8grc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-07f5f6-5b6bcc7f-bdvrj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-07f5f6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-07f5f6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-07f5f6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-07f5f6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db791102-c288-4316-98ae-1f5625055f10, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-vz567

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-07f5f6-openshift-default-98746c89f-mr8c7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-b-f14bda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f14bda-openshift-default-7c65bb6969 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1e352e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1e352e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-f14bda-openshift-default-7c65bb6969

SuccessfulCreate

Created pod: e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f14bda

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f14bda

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-46510c-openshift-default-849969b69c-9gxjp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

multus

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-db5422-7f6b57dbd7-b5nvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-db5422-8464b57b74-pgngf

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f14bda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f14bda: serviceaccount "payload-processing-e2e-praxis-b-f14bda" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f14bda-7f498d85cc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f14bda-7f498d85cc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f14bda-7f498d85cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f14bda: serviceaccount "payload-processing-e2e-praxis-b-f14bda" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f14bda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f14bda-7f498d85cc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-db5422-openshift-default-696cf4dc99-75p47

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dc0f3f-7b78d8bfdb-4s767

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dc0f3f-59446658cf-n6msk

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ff4113-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ff4113-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f14bda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f14bda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-dc0f3f-openshift-default-d9f67c9bc-ks8t6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b9dad7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b9dad7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ff4113-6fd46cb5cf-g5q8p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ff4113-679c7cdbdb-cgkkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b9dad7-7458764995-5pdtn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b9dad7-8569798f65-m9hcd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-ff4113-openshift-default-6b94f7db5f-4p87g

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

Started

Container started

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-b9dad7-openshift-default-994bfcbb9-bw5wc

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f14bda-7f498d85cc-v2z67

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f14bda-5bf9699c87-z52pg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-pcw82

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-pcw82

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f14bda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f14bda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-praxis-b-f14bda-openshift-default-dockercfg-dv7sl); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-praxis-b-f14bda-openshift-default-7c65bb6969-rdtlg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 8 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

Created

Container created

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Unhealthy

Liveness probe failed: Get "https://10.134.0.34:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Unhealthy

Readiness probe failed: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

ProbeError

Readiness probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-1e352e-openshift-default-75f8bbdbfc-gphv5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1e352e-585bf55c69-ddbn9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1e352e-6bb6bb4d7f-hd98j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-208a0d-f9cc48655-wfc6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-208a0d-6f7c665d67-pc68m

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-2729f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-2729f2

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-9xvbs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-596dc9545f from 9 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9xvbs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-6c0ec0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-6c0ec0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-6c0ec0

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

openshift-ingress

replicaset-controller

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc

SuccessfulCreate

Created pod: e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

Started

Container started

openshift-ingress

multus

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Started

Container started

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

Started

Container started

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 8 to 7

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-9jh88

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-208a0d-openshift-default-67457fb65c-ksfzw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-2729f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-2729f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-2729f2-565847c555 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-2729f2-565847c555

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-2729f2-565847c555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-2729f2: serviceaccount "payload-processing-e2e-shared-a-w1-2729f2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-2729f2: serviceaccount "payload-processing-e2e-shared-a-w1-2729f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-2729f2-565847c555

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-6c0ec0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-6c0ec0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-6c0ec0: serviceaccount "payload-processing-e2e-shared-a-w4-6c0ec0" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-6c0ec0: serviceaccount "payload-processing-e2e-shared-a-w4-6c0ec0" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-717217

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-717217

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-4248ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-4248ae

openshift-ingress

replicaset-controller

e2e-autores-4248ae-openshift-default-94bc8c67

SuccessfulCreate

Created pod: e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

openshift-ingress

deployment-controller

e2e-autores-4248ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-4248ae-openshift-default-94bc8c67 from 0 to 1

openshift-ingress

multus

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-717217

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-717217-5f86cd4989 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-717217-5f86cd4989

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-717217-5f86cd4989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-717217: serviceaccount "payload-processing-e2e-shared-a-w3-717217" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-717217: serviceaccount "payload-processing-e2e-shared-a-w3-717217" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-717217

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-717217-5f86cd4989

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tmxmj

Unhealthy

Readiness probe failed: Get "https://10.134.0.31:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4248ae-85686d5965

FailedCreate

Error creating: pods "payload-processing-e2e-autores-4248ae-85686d5965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4248ae: serviceaccount "payload-processing-e2e-autores-4248ae" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-4248ae: serviceaccount "payload-processing-e2e-autores-4248ae" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-4248ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-4248ae-69f65cb7f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-4248ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-4248ae-85686d5965 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-4248ae-85686d5965

SuccessfulCreate

Created pod: payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

openshift-ingress

kubelet

payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-4af1f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-4af1f7

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-4a697f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-4a697f

openshift-ingress

replicaset-controller

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5

SuccessfulCreate

Created pod: e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

openshift-ingress

multus

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w4-4a697f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-50e623

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-50e623

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-v2j92

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-4af1f7: serviceaccount "payload-processing-e2e-shared-b-w1-4af1f7" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-4af1f7: serviceaccount "payload-processing-e2e-shared-b-w1-4af1f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-4af1f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-4af1f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-4a697f: serviceaccount "payload-processing-e2e-shared-b-w4-4a697f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-4a697f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-4a697f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-4a697f: serviceaccount "payload-processing-e2e-shared-b-w4-4a697f" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-50e623-6d6668784c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-50e623-6d6668784c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-50e623: serviceaccount "payload-processing-e2e-shared-a-w0-50e623" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-50e623: serviceaccount "payload-processing-e2e-shared-a-w0-50e623" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-50e623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-50e623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-50e623-6d6668784c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-50e623-6d6668784c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Unhealthy

Readiness probe failed: Get "http://10.132.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

ProbeError

Readiness probe error: Get "http://10.132.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Unhealthy

Readiness probe failed: Get "http://10.132.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

ProbeError

Readiness probe error: Get "http://10.132.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 6 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulCreate

Created pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

Created

Container created

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-556c14-openshift-default-754b5bc799

SuccessfulCreate

Created pod: e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w3-556c14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-556c14-openshift-default-754b5bc799 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-556c14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-556c14

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

Created

Container created

openshift-ingress

multus

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Unhealthy

Readiness probe failed: Get "http://10.132.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

ProbeError

Readiness probe error: Get "http://10.132.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-556c14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-556c14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-556c14-566c7cc65c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-556c14: serviceaccount "payload-processing-e2e-shared-b-w3-556c14" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-556c14: serviceaccount "payload-processing-e2e-shared-b-w3-556c14" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

ProbeError

Startup probe error: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

Unhealthy

Startup probe failed: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 1 to 4

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-6c0ec0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-6c0ec0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

Unhealthy

Startup probe failed: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

Unhealthy

Startup probe failed: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

ProbeError

Startup probe error: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

ProbeError

Startup probe error: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

ProbeError

Readiness probe error: Get "http://10.134.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Unhealthy

Readiness probe failed: Get "http://10.134.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w0-020af9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-020af9-openshift-default-d77df45d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-020af9-openshift-default-d77df45d5

SuccessfulCreate

Created pod: e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-020af9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-020af9

openshift-ingress

multus

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-020af9-66449c479f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-020af9-66449c479f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-020af9: serviceaccount "payload-processing-e2e-shared-b-w0-020af9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-020af9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-020af9-66449c479f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-020af9-66449c479f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-020af9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-020af9: serviceaccount "payload-processing-e2e-shared-b-w0-020af9" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Unhealthy

Readiness probe failed: Get "http://10.134.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

ProbeError

Readiness probe error: Get "http://10.134.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-6c0ec0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-6c0ec0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Unhealthy

Readiness probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

ProbeError

Readiness probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Unhealthy

Readiness probe failed: Get "http://10.134.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

ProbeError

Readiness probe error: Get "http://10.134.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

Created

Container created

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

Started

Container started

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

ProbeError

Readiness probe error: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Unhealthy

Readiness probe failed: Get "http://10.134.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

ProbeError

Startup probe error: Get "http://10.134.0.202:15021/healthz/ready": dial tcp 10.134.0.202:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Unhealthy

Startup probe failed: Get "http://10.134.0.202:15021/healthz/ready": dial tcp 10.134.0.202:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

Unhealthy

Startup probe failed: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

ProbeError

Startup probe error: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-ktz44

Unhealthy

Readiness probe failed: Get "http://10.134.0.20:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

Unhealthy

Startup probe failed: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

ProbeError

Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

Unhealthy

Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

ProbeError

Startup probe error: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

Started

Container started

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 4 to 8

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

ProbeError

Startup probe error: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

Unhealthy

Startup probe failed: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

Created

Container created

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4248ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4248ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Unhealthy

Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

ProbeError

Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

Unhealthy

Startup probe failed: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

ProbeError

Startup probe error: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

Unhealthy

Startup probe failed: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

ProbeError

Startup probe error: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4248ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-4248ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-4248ae-69f65cb7f5-d6njn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-4248ae-85686d5965-jxtv4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Unhealthy

Readiness probe failed: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

ProbeError

Readiness probe error: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Created

Container created

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 4 to 6

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 4 to 7

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc

SuccessfulCreate

Created pod: e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-020af9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-020af9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z
(x8)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

Created

Container created

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

Started

Container started

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-84e377-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-84e377-openshift-default-5554bf8669 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

Started

Container started

openshift-ingress

replicaset-controller

e2e-explicit-84e377-openshift-default-5554bf8669

SuccessfulCreate

Created pod: e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-explicit-84e377

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-84e377
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

ProbeError

Startup probe error: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

Unhealthy

Startup probe failed: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

ProbeError

Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

Unhealthy

Startup probe failed: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused

openshift-ingress

multus

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

ProbeError

Startup probe error: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

Unhealthy

Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

ProbeError

Startup probe error: Get "http://10.134.0.225:15021/healthz/ready": dial tcp 10.134.0.225:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

Unhealthy

Startup probe failed: Get "http://10.134.0.225:15021/healthz/ready": dial tcp 10.134.0.225:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-4248ae-openshift-default-94bc8c67-b5pgk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

Unhealthy

Startup probe failed: Get "http://10.134.0.226:15021/healthz/ready": dial tcp 10.134.0.226:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

ProbeError

Startup probe error: Get "http://10.134.0.226:15021/healthz/ready": dial tcp 10.134.0.226:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs
(x8)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-84e377

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-84e377-8468cbf5b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-84e377-8468cbf5b9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-84e377-8468cbf5b9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-84e377-8468cbf5b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-84e377: serviceaccount "payload-processing-e2e-explicit-84e377" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-84e377

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-84e377-6bc89ccf99 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-84e377: serviceaccount "payload-processing-e2e-explicit-84e377" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs

AddedInterface

Add eth0 [10.134.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

Unhealthy

Startup probe failed: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

ProbeError

Startup probe error: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

(combined from similar events): Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulCreate

Created pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 8 to 10

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

Created

Container created

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

ProbeError

Startup probe error: Get "http://10.134.0.230:15021/healthz/ready": dial tcp 10.134.0.230:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

Unhealthy

Startup probe failed: Get "http://10.134.0.230:15021/healthz/ready": dial tcp 10.134.0.230:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-020af9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-020af9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-l9ccf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-596dc9545f from 8 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-l9ccf
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

ProbeError

Startup probe error: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Unhealthy

Startup probe failed: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-556c14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-556c14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Unhealthy

Startup probe failed: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

ProbeError

Startup probe error: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-556c14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-556c14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-84e377-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-84e377-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-explicit-84e377-8468cbf5b9-wx4nd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-84e377-6bc89ccf99-pczgs

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-84e377-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-84e377-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7031-b93ad0

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7031-b93ad0

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7031-b93ad0

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.197s (1.197s including waiting). Image size: 106100986 bytes.

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

opendatahub

kubelet

test-curl-7031-b93ad0

Started

Container started

openshift-ingress

kubelet

e2e-explicit-84e377-openshift-default-5554bf8669-lzzbj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7031-b93ad0

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-531447

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-531447

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

opendatahub

kubelet

test-curl-7031-b93ad0

Killing

Stopping container test-curl-7031-b93ad0

openshift-ingress

deployment-controller

e2e-shared-a-w2-531447-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-531447-openshift-default-7995d46767 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-531447: serviceaccount "payload-processing-e2e-shared-a-w2-531447" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-531447-667d774bfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-531447-667d774bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-531447: serviceaccount "payload-processing-e2e-shared-a-w2-531447" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-531447

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-531447-667d774bfc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-531447

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-531447-667d774bfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

AddedInterface

Add eth0 [10.134.0.236/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7028-d89cda

Started

Container started

opendatahub

kubelet

test-curl-7028-d89cda

Created

Container created

opendatahub

kubelet

test-curl-7028-d89cda

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7028-d89cda

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7028-f5c007

Started

Container started

opendatahub

multus

test-curl-7028-f5c007

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7028-f5c007

Created

Container created

opendatahub

kubelet

test-curl-7028-f5c007

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7028-d89cda

Killing

Stopping container test-curl-7028-d89cda

opendatahub

kubelet

test-curl-7028-0c2035

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7028-0c2035

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7028-0c2035

Created

Container created

opendatahub

kubelet

test-curl-7028-f5c007

Killing

Stopping container test-curl-7028-f5c007

opendatahub

kubelet

test-curl-7028-0c2035

Started

Container started

opendatahub

kubelet

test-curl-7028-86b699

Created

Container created

opendatahub

kubelet

test-curl-7028-86b699

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7028-86b699

Started

Container started

opendatahub

multus

test-curl-7028-86b699

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7028-0c2035

Killing

Stopping container test-curl-7028-0c2035

openshift-ingress

replicaset-controller

e2e-extmod-a-821f5a-openshift-default-7bfc657d9

SuccessfulCreate

Created pod: e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-821f5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-821f5a

opendatahub

kubelet

test-curl-7028-86b699

Killing

Stopping container test-curl-7028-86b699

openshift-ingress

deployment-controller

e2e-extmod-a-821f5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-821f5a-openshift-default-7bfc657d9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-821f5a-7655cbb57c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-821f5a-7655cbb57c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-821f5a: serviceaccount "payload-processing-e2e-extmod-a-821f5a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-821f5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-821f5a-84858c594c from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-821f5a: serviceaccount "payload-processing-e2e-extmod-a-821f5a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-821f5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-821f5a-7655cbb57c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-821f5a-7655cbb57c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-ef434a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-ef434a

openshift-ingress

deployment-controller

e2e-shared-b-w2-ef434a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc

SuccessfulCreate

Created pod: e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

openshift-ingress

multus

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ef434a: serviceaccount "payload-processing-e2e-shared-b-w2-ef434a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-ef434a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-ef434a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ef434a: serviceaccount "payload-processing-e2e-shared-b-w2-ef434a" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-jvqst

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-jvqst

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jvqst

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jvqst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jvqst

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jvqst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jvqst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-821f5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-821f5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-af8244

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-af8244

openshift-ingress

replicaset-controller

e2e-extmod-b-af8244-openshift-default-594d5d565c

SuccessfulCreate

Created pod: e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

openshift-ingress

deployment-controller

e2e-extmod-b-af8244-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-af8244-openshift-default-594d5d565c from 0 to 1

openshift-ingress

multus

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5

SuccessfulCreate

Created pod: e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-af8244

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-af8244-75d9474dd7 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-af8244-75d9474dd7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-af8244-75d9474dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-af8244: serviceaccount "payload-processing-e2e-extmod-b-af8244" not found

openshift-ingress

multus

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-af8244: serviceaccount "payload-processing-e2e-extmod-b-af8244" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-af8244

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-af8244-84f67c568c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-af8244-75d9474dd7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-027c19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-027c19

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-027c19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-027c19-openshift-default-58d5bc7645 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-027c19-openshift-default-58d5bc7645

SuccessfulCreate

Created pod: e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

Created

Container created

openshift-ingress

multus

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 10 to 9

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-dthhl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

Unhealthy

Startup probe failed: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

ProbeError

Startup probe error: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused body:

opendatahub

multus

test-curl-7037-279bc9

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7037-279bc9

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-027c19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-027c19-596c6c9695 from 0 to 1

opendatahub

kubelet

test-curl-7037-279bc9

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-027c19-67b548955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-027c19-67b548955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-027c19: serviceaccount "payload-processing-e2e-extmod-a-027c19" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-027c19-596c6c9695

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-027c19-596c6c9695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-027c19: serviceaccount "payload-processing-e2e-extmod-a-027c19" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-027c19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-027c19-67b548955 from 0 to 1

opendatahub

kubelet

test-curl-7037-279bc9

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-027c19-67b548955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

openshift-ingress

multus

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-027c19-596c6c9695

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-7c759a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-7c759a-openshift-default-56576554df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-7c759a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-7c759a

openshift-ingress

replicaset-controller

e2e-extmod-a-7c759a-openshift-default-56576554df

SuccessfulCreate

Created pod: e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

opendatahub

kubelet

test-curl-7037-279bc9

Killing

Stopping container test-curl-7037-279bc9
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Unhealthy

Readiness probe failed: Get "http://10.132.0.201:15021/healthz/ready": read tcp 10.132.0.2:46496->10.132.0.201:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

ProbeError

Readiness probe error: Get "http://10.132.0.201:15021/healthz/ready": read tcp 10.132.0.2:46496->10.132.0.201:15021: read: connection reset by peer body:

openshift-ingress

multus

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-7c759a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-7c759a: serviceaccount "payload-processing-e2e-extmod-a-7c759a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-7c759a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-7c759a-7745bc7499 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-7c759a-7745bc7499

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-7c759a-7745bc7499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-7c759a: serviceaccount "payload-processing-e2e-extmod-a-7c759a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-7c759a-7745bc7499

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 9 to 8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-g4cld
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-r6t2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9lp9t

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef434a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef434a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-noten-a23ed0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-a23ed0

openshift-ingress

deployment-controller

e2e-noten-a23ed0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-a23ed0-openshift-default-84685cd7b7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-a23ed0-openshift-default-84685cd7b7

SuccessfulCreate

Created pod: e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

openshift-ingress

kubelet

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

Created

Container created

openshift-ingress

multus

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

Started

Container started

openshift-ingress

kubelet

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

Created

Container created

openshift-ingress

multus

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w0-020af9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-020af9-openshift-default-d77df45d5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w0-020af9-openshift-default-d77df45d5

SuccessfulCreate

Created pod: e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-020af9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x8)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

ProbeError

Startup probe error: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-flb5n

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 8 to 7
(x8)

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

Unhealthy

Startup probe failed: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

opendatahub

kubelet

test-curl-7034-aaa247

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef434a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7034-aaa247

Started

Container started

opendatahub

multus

test-curl-7034-aaa247

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef434a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7034-aaa247

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-t5bt4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-t5bt4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-596dc9545f from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-a23ed0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-a23ed0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7034-aaa247

Killing

Stopping container test-curl-7034-aaa247

openshift-ingress

kubelet

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

openshift-ingress

kubelet

e2e-noten-a23ed0-openshift-default-84685cd7b7-6vgvw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-cv2rj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-ckb7r

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-5rvtq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-t9s6q

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-3c5983

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-3c5983

openshift-ingress

replicaset-controller

e2e-extmod-b-3c5983-openshift-default-86c5bc855c

SuccessfulCreate

Created pod: e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

openshift-ingress

deployment-controller

e2e-extmod-b-3c5983-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-3c5983-openshift-default-86c5bc855c from 0 to 1

openshift-ingress

multus

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-zj5jg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-z7flk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 10 to 8

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ldr7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-mlblk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-3c5983

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-3c5983-7fbf586cf5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3c5983: serviceaccount "payload-processing-e2e-extmod-b-3c5983" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-3c5983

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-3c5983-564977cd99 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-556c14-openshift-default-754b5bc799

SuccessfulCreate

Created pod: e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3c5983: serviceaccount "payload-processing-e2e-extmod-b-3c5983" not found

openshift-ingress

multus

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-57079b-openshift-default-5c84d8878f

SuccessfulCreate

Created pod: e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

openshift-ingress

deployment-controller

e2e-extmod-b-57079b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-57079b-openshift-default-5c84d8878f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-57079b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-57079b

openshift-ingress

multus

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d25759

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d25759

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-57079b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-57079b-666f95c947 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-57079b-666f95c947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-57079b-666f95c947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-57079b-666f95c947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-57079b: serviceaccount "payload-processing-e2e-extmod-b-57079b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-57079b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-57079b-5f4958f857 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-57079b-5f4958f857

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-57079b-5f4958f857

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-57079b-5f4958f857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-57079b: serviceaccount "payload-processing-e2e-extmod-b-57079b" not found
(x9)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-ddd653-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ddd653-openshift-default-779ff6465 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ddd653-openshift-default-779ff6465

SuccessfulCreate

Created pod: e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ddd653

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ddd653

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d25759-857574b47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d25759

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d25759-857574b47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d25759-5587dc5df9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d25759

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d25759-5587dc5df9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d25759-857574b47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d25759-857574b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d25759: serviceaccount "payload-processing-e2e-extmod-a-d25759" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d25759-5587dc5df9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d25759-5587dc5df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d25759: serviceaccount "payload-processing-e2e-extmod-a-d25759" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ddd653

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ddd653-84dfd5bd67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ddd653

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ddd653: serviceaccount "payload-processing-e2e-extmod-a-ddd653" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ddd653: serviceaccount "payload-processing-e2e-extmod-a-ddd653" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Unhealthy

Readiness probe failed: Get "http://10.132.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

ProbeError

Readiness probe error: Get "http://10.132.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-af8244-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-af8244-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-7c759a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-7c759a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

Unhealthy

Startup probe failed: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

ProbeError

Startup probe error: Get "http://10.134.0.252:15021/healthz/ready": dial tcp 10.134.0.252:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-027c19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-027c19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-7c759a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-7c759a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-027c19-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-027c19-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

ProbeError

Readiness probe error: Get "http://10.132.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-extmod-b-e1f08d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-e1f08d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-e1f08d

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Unhealthy

Readiness probe failed: Get "http://10.132.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9

SuccessfulCreate

Created pod: e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 1 to 4

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-be59df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-be59df

openshift-ingress

deployment-controller

e2e-extmod-b-be59df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-be59df-openshift-default-6764f766d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-be59df-openshift-default-6764f766d9

SuccessfulCreate

Created pod: e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Unhealthy

Readiness probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

ProbeError

Readiness probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-57079b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-57079b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Unhealthy

Readiness probe failed: Get "http://10.132.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

ProbeError

Readiness probe error: Get "http://10.132.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

ProbeError

Startup probe error: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Unhealthy

Startup probe failed: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Unhealthy

Startup probe failed: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ddd653-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

ProbeError

Startup probe error: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ddd653-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3c5983-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3c5983-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-57079b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-57079b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 4 to 8

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulCreate

Created pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ddd653-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ddd653-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3c5983-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3c5983-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-pvzvs

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-d55st

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 7 to 5

openshift-ingress

multus

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-e1f08d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e1f08d: serviceaccount "payload-processing-e2e-extmod-b-e1f08d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-e1f08d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e1f08d: serviceaccount "payload-processing-e2e-extmod-b-e1f08d" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 8 to 6

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-czgh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dqlwj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Created

Container created

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

AddedInterface

Add eth0 [10.134.1.7/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Unhealthy

Startup probe failed: Get "http://10.134.1.7:15021/healthz/ready": dial tcp 10.134.1.7:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

ProbeError

Startup probe error: Get "http://10.134.1.7:15021/healthz/ready": dial tcp 10.134.1.7:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-rf5cn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9

SuccessfulCreate

Created pod: e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

openshift-ingress

deployment-controller

e2e-extmod-b-e1f08d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9

SuccessfulCreate

Created pod: e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes
(x12)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-be59df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

ProbeError

Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

Unhealthy

Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

ProbeError

Startup probe error: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

Unhealthy

Startup probe failed: Get "http://10.134.1.2:15021/healthz/ready": dial tcp 10.134.1.2:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-af8244-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-af8244-openshift-default-594d5d565c from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-c5gln

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-af8244-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-af8244-openshift-default-594d5d565c

SuccessfulCreate

Created pod: e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

openshift-ingress

deployment-controller

e2e-extmod-b-3c5983-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-3c5983-openshift-default-86c5bc855c from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-3c5983-openshift-default-86c5bc855c

SuccessfulCreate

Created pod: e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3c5983-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x13)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-be59df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 7 to 6

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xj4dr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

Created

Container created

openshift-ingress

multus

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x10)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x10)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-596dc9545f from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-skx44

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 8 to 6

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-whq6r

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-tt9jg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-skx44

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-h2p2p

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

AddedInterface

Add eth0 [10.134.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Created

Container created

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

AddedInterface

Add eth0 [10.134.1.21/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Unhealthy

Startup probe failed: Get "http://10.134.1.20:15021/healthz/ready": dial tcp 10.134.1.20:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

ProbeError

Startup probe error: Get "http://10.134.1.20:15021/healthz/ready": dial tcp 10.134.1.20:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

AddedInterface

Add eth0 [10.132.0.249/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Unhealthy

Startup probe failed: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

ProbeError

Startup probe error: Get "http://10.134.1.21:15021/healthz/ready": dial tcp 10.134.1.21:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-be59df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-be59df-c7b8b85f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-be59df: serviceaccount "payload-processing-e2e-extmod-b-be59df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-be59df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-be59df-bb748fd99 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-be59df-c7b8b85f5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-be59df-c7b8b85f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-be59df: serviceaccount "payload-processing-e2e-extmod-b-be59df" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-be59df-c7b8b85f5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.555s (3.555s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-hs4f9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 8 to 7

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 10 to 7

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-78zwt

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-c5x7c

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-v8jpj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Created

Container created

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

AddedInterface

Add eth0 [10.134.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Started

Container started

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

AddedInterface

Add eth0 [10.134.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Unhealthy

Startup probe failed: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

ProbeError

Startup probe error: Get "http://10.132.0.251:15021/healthz/ready": dial tcp 10.132.0.251:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

ProbeError

Startup probe error: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

Unhealthy

Startup probe failed: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-2dshc

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 7 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Unhealthy

Startup probe failed: Get "http://10.134.1.25:15021/healthz/ready": dial tcp 10.134.1.25:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

ProbeError

Startup probe error: Get "http://10.134.1.25:15021/healthz/ready": dial tcp 10.134.1.25:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

ProbeError

Startup probe error: Get "http://10.134.1.24:15021/healthz/ready": dial tcp 10.134.1.24:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Unhealthy

Startup probe failed: Get "http://10.134.1.24:15021/healthz/ready": dial tcp 10.134.1.24:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

AddedInterface

Add eth0 [10.134.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Unhealthy

Startup probe failed: Get "http://10.134.1.26:15021/healthz/ready": dial tcp 10.134.1.26:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

ProbeError

Startup probe error: Get "http://10.134.1.26:15021/healthz/ready": dial tcp 10.134.1.26:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

ProbeError

Readiness probe error: Get "http://10.132.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Unhealthy

Readiness probe failed: Get "http://10.132.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg
(x6)

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

ProbeError

Startup probe error: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Unhealthy

Startup probe failed: Get "http://10.132.0.249:15021/healthz/ready": dial tcp 10.132.0.249:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rgsmg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 6 to 5

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-dmrf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-bpgmb

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-5mm5t

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-hp4l7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-821f5a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-821f5a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-b229j

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-prff2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-be59df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-hbp26

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 5 to 4

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 5 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-wzfts

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-bwzqd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

models-as-a-service

replicaset-controller

payload-processing-external-model-858d96bddf

SuccessfulCreate

Created pod: payload-processing-external-model-858d96bddf-mjhfr
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-858d96bddf

FailedCreate

Error creating: pods "payload-processing-external-model-858d96bddf-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-858d96bddf from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-858d96bddf-mjhfr

Started

Container started

models-as-a-service

multus

payload-processing-external-model-858d96bddf-mjhfr

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-858d96bddf-mjhfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-858d96bddf-mjhfr

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-ddd653-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ddd653-openshift-default-779ff6465 from 1 to 2

openshift-ingress

multus

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

AddedInterface

Add eth0 [10.134.1.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ddd653-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-ddd653-openshift-default-779ff6465

SuccessfulCreate

Created pod: e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

ProbeError

Startup probe error: Get "http://10.134.1.37:15021/healthz/ready": dial tcp 10.134.1.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

Unhealthy

Startup probe failed: Get "http://10.134.1.37:15021/healthz/ready": dial tcp 10.134.1.37:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-67757c7bbc from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-67757c7bbc

SuccessfulCreate

Created pod: payload-processing-external-model-67757c7bbc-7lndz

models-as-a-service

kubelet

payload-processing-external-model-67757c7bbc-7lndz

Created

Container created

models-as-a-service

multus

payload-processing-external-model-67757c7bbc-7lndz

AddedInterface

Add eth0 [10.132.1.13/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-67757c7bbc-7lndz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-67757c7bbc-7lndz

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-858d96bddf

SuccessfulDelete

Deleted pod: payload-processing-external-model-858d96bddf-mjhfr

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-858d96bddf from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-858d96bddf-mjhfr

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5774fbf4b9

SuccessfulCreate

Created pod: payload-processing-external-model-5774fbf4b9-pl5dw

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5774fbf4b9 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5774fbf4b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-5774fbf4b9-pl5dw

models-as-a-service

kubelet

payload-processing-external-model-5774fbf4b9-pl5dw

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5774fbf4b9-pl5dw

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5774fbf4b9-pl5dw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5774fbf4b9-pl5dw

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5774fbf4b9 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn

Killing

Stopping container istio-proxy

models-as-a-service

kubelet

payload-processing-external-model-5774fbf4b9-pl5dw

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-76c77f5454

SuccessfulCreate

Created pod: payload-processing-external-model-76c77f5454-kqvq2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: All metrics below target

models-as-a-service

multus

payload-processing-external-model-76c77f5454-kqvq2

AddedInterface

Add eth0 [10.132.1.16/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6gtmn
(x4)

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 5 to 4

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-kqvq2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-kqvq2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-kqvq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-76c77f5454

SuccessfulDelete

Deleted pod: payload-processing-external-model-76c77f5454-kqvq2

models-as-a-service

replicaset-controller

payload-processing-external-model-59dbb77fb8

SuccessfulCreate

Created pod: payload-processing-external-model-59dbb77fb8-5h2hn

models-as-a-service

replicaset-controller

payload-processing-external-model-76c77f5454

SuccessfulCreate

Created pod: payload-processing-external-model-76c77f5454-5cg5j

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-kqvq2

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-59dbb77fb8

SuccessfulDelete

Deleted pod: payload-processing-external-model-59dbb77fb8-5h2hn

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-5cg5j

Created

Container created

models-as-a-service

multus

payload-processing-external-model-76c77f5454-5cg5j

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes
(x3)

models-as-a-service

kubelet

payload-processing-external-model-59dbb77fb8-5h2hn

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7379d3751ff2" not found

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-5cg5j

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-5cg5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 5 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-fjz5c

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-kr275

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-vm5w5

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 5 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-w9dmz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-fjz5c

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-r2cgw

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-46hnd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-kr275

AddedInterface

Add eth0 [10.134.1.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Killing

Stopping container istio-proxy

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-46hnd

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-r2cgw

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-vm5w5

AddedInterface

Add eth0 [10.132.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-shrff

Killing

Stopping container istio-proxy

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-5cg5j

Killing

Stopping container payload-processing
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-59dbb77fb8 from 0 to 1
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-76c77f5454 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-76c77f5454

SuccessfulDelete

Deleted pod: payload-processing-external-model-76c77f5454-5cg5j

models-as-a-service

replicaset-controller

payload-processing-external-model-59dbb77fb8

SuccessfulCreate

Created pod: payload-processing-external-model-59dbb77fb8-grz4z

models-as-a-service

kubelet

payload-processing-external-model-59dbb77fb8-grz4z

Created

Container created

models-as-a-service

multus

payload-processing-external-model-59dbb77fb8-grz4z

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-59dbb77fb8-grz4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-h5j8d

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-59dbb77fb8-grz4z

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-59dbb77fb8

SuccessfulDelete

Deleted pod: payload-processing-external-model-59dbb77fb8-grz4z
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

ProbeError

Startup probe error: Get "http://10.134.1.41:15021/healthz/ready": dial tcp 10.134.1.41:15021: connect: connection refused body:
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-59dbb77fb8 from 1 to 0
(x3)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-76c77f5454 from 0 to 1
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

Unhealthy

Startup probe failed: Get "http://10.134.1.41:15021/healthz/ready": dial tcp 10.134.1.41:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-76c77f5454

SuccessfulCreate

Created pod: payload-processing-external-model-76c77f5454-842p6
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-842p6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

Unhealthy

Startup probe failed: Get "http://10.134.1.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-842p6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-842p6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

ProbeError

Startup probe error: Get "http://10.134.1.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

multus

payload-processing-external-model-76c77f5454-842p6

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-59dbb77fb8-grz4z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

Unhealthy

Startup probe failed: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Unhealthy

Startup probe failed: Get "http://10.132.1.20:15021/healthz/ready": dial tcp 10.132.1.20:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

ProbeError

Startup probe error: Get "http://10.132.1.20:15021/healthz/ready": dial tcp 10.132.1.20:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

ProbeError

Startup probe error: Get "http://10.132.1.21:15021/healthz/ready": dial tcp 10.132.1.21:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

ProbeError

Startup probe error: Get "http://10.132.1.21:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

ProbeError

Startup probe error: Get "http://10.132.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Unhealthy

Startup probe failed: Get "http://10.132.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

models-as-a-service

kubelet

payload-processing-external-model-59dbb77fb8-grz4z

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7379d3751ff2" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-027c19-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-027c19-openshift-default-58d5bc7645

SuccessfulCreate

Created pod: e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

openshift-ingress

deployment-controller

e2e-extmod-a-027c19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-027c19-openshift-default-58d5bc7645 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

AddedInterface

Add eth0 [10.134.1.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-67757c7bbc

SuccessfulDelete

Deleted pod: payload-processing-external-model-67757c7bbc-7lndz

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-67757c7bbc from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-67757c7bbc-7lndz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

ProbeError

Readiness probe error: Get "http://10.134.1.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-kr275

Unhealthy

Readiness probe failed: Get "http://10.134.1.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

Unhealthy

Startup probe failed: Get "http://10.134.1.43:15021/healthz/ready": dial tcp 10.134.1.43:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

ProbeError

Startup probe error: Get "http://10.134.1.43:15021/healthz/ready": dial tcp 10.134.1.43:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 6 to 5

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-k65g2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 4 to 3

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-jl44w

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-tc5dx

Killing

Stopping container istio-proxy

models-as-a-service

kubelet

payload-processing-external-model-76c77f5454-842p6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-a88862-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a88862-openshift-default-7b98d598f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a88862

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a88862

openshift-ingress

replicaset-controller

e2e-inf-a-a88862-openshift-default-7b98d598f

SuccessfulCreate

Created pod: e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

openshift-ingress

multus

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

AddedInterface

Add eth0 [10.132.1.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-821f5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-821f5a-openshift-default-7bfc657d9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-821f5a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-821f5a-openshift-default-7bfc657d9

SuccessfulCreate

Created pod: e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a88862

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a88862-57bd8764b7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a88862: serviceaccount "payload-processing-e2e-inf-a-a88862" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a88862

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a88862-6bccb6967f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a88862-6bccb6967f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a88862-6bccb6967f-46486
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a88862-6bccb6967f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a88862-6bccb6967f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a88862: serviceaccount "payload-processing-e2e-inf-a-a88862" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

AddedInterface

Add eth0 [10.132.1.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

AddedInterface

Add eth0 [10.134.1.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:
(x31)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 8 to 7

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulDelete

Deleted pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-5lkrv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ce04af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ce04af

openshift-ingress

deployment-controller

e2e-inf-b-ce04af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ce04af-openshift-default-7dccd45f47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

openshift-ingress

multus

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

AddedInterface

Add eth0 [10.134.1.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ce04af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ce04af-6b9b884869 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ce04af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ce04af: serviceaccount "payload-processing-e2e-inf-b-ce04af" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ce04af-6b9b884869

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ce04af-6b9b884869

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ce04af-6b9b884869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ce04af: serviceaccount "payload-processing-e2e-inf-b-ce04af" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

AddedInterface

Add eth0 [10.134.1.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

AddedInterface

Add eth0 [10.134.1.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Unhealthy

Readiness probe failed: Get "http://10.132.1.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

ProbeError

Readiness probe error: Get "http://10.132.1.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ce04af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ce04af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Unhealthy

Startup probe failed: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

ProbeError

Startup probe error: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a88862-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a88862-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a88862-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a88862-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-tt72j

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

openshift-ingress

deployment-controller

e2e-inf-b-ce04af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ce04af-openshift-default-7dccd45f47 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ce04af-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

Started

Container started

openshift-ingress

multus

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

ProbeError

Readiness probe error: Get "http://10.134.1.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Unhealthy

Readiness probe failed: Get "http://10.134.1.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Started

Container started

openshift-ingress

multus

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

AddedInterface

Add eth0 [10.132.1.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ce04af-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-inf-b-ce04af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ce04af-openshift-default-7dccd45f47 from 4 to 8

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-gswcf

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-q8qhz

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-wg7jh
(x2)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Unhealthy

Startup probe failed: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

ProbeError

Startup probe error: Get "http://10.132.1.42:15021/healthz/ready": dial tcp 10.132.1.42:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 4 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-gwl6k
(x7)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Unhealthy

Startup probe failed: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-ee618c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ee618c-openshift-default-5ff9c74dc9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ee618c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ee618c

openshift-ingress

multus

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

AddedInterface

Add eth0 [10.132.1.43/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

ProbeError

Startup probe error: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Started

Container started

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

AddedInterface

Add eth0 [10.134.1.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

openshift-ingress

replicaset-controller

e2e-inf-b-ce04af-openshift-default-7dccd45f47

SuccessfulCreate

(combined from similar events): Created pod: e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ce04af-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

e2e-inf-b-ce04af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ce04af-openshift-default-7dccd45f47 from 8 to 10

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ee618c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ee618c: serviceaccount "payload-processing-e2e-inf-a-ee618c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ee618c-7bc658cb5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml
(x8)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Unhealthy

Startup probe failed: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ee618c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ee618c-7bc658cb5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ee618c-7bc658cb5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ee618c-7bc658cb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ee618c: serviceaccount "payload-processing-e2e-inf-a-ee618c" not found
(x8)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

ProbeError

Startup probe error: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-7c759a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-7c759a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-7c759a-openshift-default-56576554df from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-7c759a-openshift-default-56576554df

SuccessfulCreate

Created pod: e2e-extmod-a-7c759a-openshift-default-56576554df-2k9wb

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a88862-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-a-a88862-openshift-default-7b98d598f

SuccessfulCreate

Created pod: e2e-inf-a-a88862-openshift-default-7b98d598f-bt5vt

openshift-ingress

deployment-controller

e2e-inf-a-a88862-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a88862-openshift-default-7b98d598f from 1 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

AddedInterface

Add eth0 [10.132.1.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

AddedInterface

Add eth0 [10.134.1.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4b17ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4b17ac

openshift-ingress

deployment-controller

e2e-inf-a-4b17ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4b17ac-openshift-default-6b75f999cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-4b17ac-openshift-default-6b75f999cf

SuccessfulCreate

Created pod: e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-g87sd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-inf-a-b6afd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b6afd6

openshift-ingress

kubelet

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-a-b6afd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b6afd6-openshift-default-78d46d7dcc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc

SuccessfulCreate

Created pod: e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4b17ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4b17ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4b17ac-5867b8956f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4b17ac: serviceaccount "payload-processing-e2e-inf-a-4b17ac" not found

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4b17ac-5867b8956f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4b17ac-5867b8956f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4b17ac: serviceaccount "payload-processing-e2e-inf-a-4b17ac" not found

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-tkzdb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4b17ac-5867b8956f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j52qt

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-bktsz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-5m78z

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 5 to 4

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

AddedInterface

Add eth0 [10.132.1.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Created

Container created

openshift-ingress

multus

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

AddedInterface

Add eth0 [10.134.1.60/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4b17ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

AddedInterface

Add eth0 [10.134.1.61/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4b17ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

AddedInterface

Add eth0 [10.132.1.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

ProbeError

Readiness probe error: Get "http://10.134.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Unhealthy

Readiness probe failed: Get "http://10.134.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Unhealthy

Startup probe failed: Get "http://10.132.1.48:15021/healthz/ready": dial tcp 10.132.1.48:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-b6afd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b6afd6: serviceaccount "payload-processing-e2e-inf-a-b6afd6" not found
(x6)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

ProbeError

Startup probe error: Get "http://10.132.1.48:15021/healthz/ready": dial tcp 10.132.1.48:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-b6afd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-b6afd6-786d97f6c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b6afd6-786d97f6c5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-b6afd6-786d97f6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b6afd6: serviceaccount "payload-processing-e2e-inf-a-b6afd6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b6afd6-786d97f6c5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

AddedInterface

Add eth0 [10.134.1.63/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

ProbeError

Startup probe error: Get "http://10.132.1.49:15021/healthz/ready": dial tcp 10.132.1.49:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8
(x7)

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

Unhealthy

Startup probe failed: Get "http://10.132.1.49:15021/healthz/ready": dial tcp 10.132.1.49:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-ee618c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ee618c-openshift-default-5ff9c74dc9 from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4b17ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-4b17ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Unhealthy

Startup probe failed: Get "http://10.134.1.54:15021/healthz/ready": dial tcp 10.134.1.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

ProbeError

Startup probe error: Get "http://10.134.1.54:15021/healthz/ready": dial tcp 10.134.1.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-5bfc51-openshift-default-54d8846889

SuccessfulCreate

Created pod: e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5bfc51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5bfc51

openshift-ingress

deployment-controller

e2e-inf-b-5bfc51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5bfc51-openshift-default-54d8846889 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957

SuccessfulCreate

Created pod: e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6fec8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6fec8a

openshift-ingress

deployment-controller

e2e-inf-a-6fec8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6fec8a-openshift-default-5cc5f9b957 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 7 to 6

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulDelete

Deleted pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-hbjwh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

AddedInterface

Add eth0 [10.134.1.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-ee618c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ee618c-openshift-default-5ff9c74dc9 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5bfc51-86f8495ff9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5bfc51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5bfc51-86f8495ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5bfc51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5bfc51: serviceaccount "payload-processing-e2e-inf-b-5bfc51" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5bfc51-86f8495ff9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5bfc51-86f8495ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5bfc51: serviceaccount "payload-processing-e2e-inf-b-5bfc51" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

AddedInterface

Add eth0 [10.134.1.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

openshift-ingress

replicaset-controller

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9

SuccessfulCreate

(combined from similar events): Created pod: e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ee618c-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-inf-a-ee618c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ee618c-openshift-default-5ff9c74dc9 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulDelete

Deleted pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 6 to 5

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-ggf9t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

AddedInterface

Add eth0 [10.132.1.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Unhealthy

Readiness probe failed: Get "http://10.134.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6fec8a-c89f98cff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6fec8a-c89f98cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6fec8a: serviceaccount "payload-processing-e2e-inf-a-6fec8a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6fec8a: serviceaccount "payload-processing-e2e-inf-a-6fec8a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6fec8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6fec8a-c89f98cff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6fec8a-c89f98cff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6fec8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

ProbeError

Readiness probe error: Get "http://10.134.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-r2cgw
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-596dc9545f from 10 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-r2cgw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5bfc51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5bfc51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

ProbeError

Startup probe error: Get "http://10.134.1.66:15021/healthz/ready": dial tcp 10.134.1.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Unhealthy

Startup probe failed: Get "http://10.134.1.66:15021/healthz/ready": dial tcp 10.134.1.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

AddedInterface

Add eth0 [10.132.1.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-a88862-openshift-default-7b98d598f-jbgzc

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

ProbeError

Startup probe error: Get "http://10.132.1.51:15021/healthz/ready": dial tcp 10.132.1.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

Unhealthy

Startup probe failed: Get "http://10.132.1.51:15021/healthz/ready": dial tcp 10.132.1.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a88862-6bccb6967f-46486

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a88862-57bd8764b7-vsv9f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-fcw4z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-p548h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-wc5pz

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

ProbeError

Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

Unhealthy

Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-75xwt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-n5ndk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-ce04af-openshift-default-7dccd45f47-vxtn5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Created

Container created

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Started

Container started

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

AddedInterface

Add eth0 [10.132.1.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

AddedInterface

Add eth0 [10.134.1.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5bfc51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5bfc51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

ProbeError

Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Unhealthy

Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

ProbeError

Startup probe error: Get "http://10.132.1.54:15021/healthz/ready": dial tcp 10.132.1.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

ProbeError

Startup probe error: Get "http://10.134.1.70:15021/healthz/ready": dial tcp 10.134.1.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Unhealthy

Startup probe failed: Get "http://10.134.1.70:15021/healthz/ready": dial tcp 10.134.1.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Unhealthy

Startup probe failed: Get "http://10.132.1.54:15021/healthz/ready": dial tcp 10.132.1.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Unhealthy

Startup probe failed: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

ProbeError

Startup probe error: Get "http://10.132.1.53:15021/healthz/ready": dial tcp 10.132.1.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ce04af-6b9b884869-vwgxv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ce04af-ffcb7d45f-zdv8k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5dab6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5dab6a

openshift-ingress

deployment-controller

e2e-inf-b-5dab6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5dab6a-openshift-default-6ff495656c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-5dab6a-openshift-default-6ff495656c

SuccessfulCreate

Created pod: e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

openshift-ingress

multus

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

AddedInterface

Add eth0 [10.134.1.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b4971a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b4971a

openshift-ingress

deployment-controller

e2e-inf-b-b4971a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b4971a-openshift-default-5dc48765 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-b4971a-openshift-default-5dc48765

SuccessfulCreate

Created pod: e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4b17ac-5867b8956f-tlz2b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4b17ac-84f44c7d99-8286l

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5dab6a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5dab6a-6c4b59c89 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5dab6a: serviceaccount "payload-processing-e2e-inf-b-5dab6a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5dab6a-6c4b59c89

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5dab6a-6c4b59c89

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5dab6a-6c4b59c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5dab6a: serviceaccount "payload-processing-e2e-inf-b-5dab6a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5dab6a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5dab6a-57cf987799 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

AddedInterface

Add eth0 [10.132.1.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

ProbeError

Readiness probe error: Get "http://10.132.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Unhealthy

Readiness probe failed: Get "http://10.132.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8dx487

Unhealthy

Readiness probe failed: Get "https://10.132.0.39:8000/ready": context deadline exceeded

openshift-ingress

multus

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

AddedInterface

Add eth0 [10.134.1.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.170:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

ProbeError

Readiness probe error: Get "http://10.134.1.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Unhealthy

Readiness probe failed: Get "http://10.134.1.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

ProbeError

Readiness probe error: Get "http://10.132.1.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

Unhealthy

Readiness probe failed: Get "http://10.132.1.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-4b17ac-openshift-default-6b75f999cf-k5vtr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-lsz2g

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 9 to 10
(x2)

openshift-ingress

kubelet

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

Created

Container created

openshift-ingress

multus

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

AddedInterface

Add eth0 [10.132.1.59/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

ProbeError

Startup probe error: Get "http://10.134.1.60:15021/healthz/ready": dial tcp 10.134.1.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Unhealthy

Startup probe failed: Get "http://10.134.1.60:15021/healthz/ready": dial tcp 10.134.1.60:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b4971a-558c5458f5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b4971a-558c5458f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b4971a: serviceaccount "payload-processing-e2e-inf-b-b4971a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b4971a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b4971a-558c5458f5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b4971a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b4971a-6c58f96447 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b4971a-558c5458f5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b4971a: serviceaccount "payload-processing-e2e-inf-b-b4971a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

AddedInterface

Add eth0 [10.132.1.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6fec8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6fec8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

Unhealthy

Startup probe failed: Get "http://10.132.1.50:15021/healthz/ready": dial tcp 10.132.1.50:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b6afd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b6afd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

ProbeError

Startup probe error: Get "http://10.132.1.50:15021/healthz/ready": dial tcp 10.132.1.50:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5dab6a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5dab6a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-sw79f

Started

Container started

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-sw79f

Pulled

Container image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-sw79f

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-sw79f

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:8081/readyz": dial tcp 10.133.0.37:8081: connect: connection refused
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b6afd6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b6afd6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

dns-operator-controller-manager-8557cbdb84-sw79f_fc288972-676e-41b8-b878-c6824107dc3d

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-sw79f_fc288972-676e-41b8-b878-c6824107dc3d became leader

openshift-ingress

deployment-controller

e2e-extmod-b-e1f08d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9

SuccessfulDelete

Deleted pod: e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-7nssr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-extmod-a-7c759a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-7c759a-openshift-default-56576554df from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-kw7mm

openshift-ingress

replicaset-controller

e2e-extmod-a-7c759a-openshift-default-56576554df

SuccessfulDelete

Deleted pod: e2e-extmod-a-7c759a-openshift-default-56576554df-2k9wb

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-7c759a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

AddedInterface

Add eth0 [10.134.1.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

Created

Container created
(x17)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-8gm8n

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-r2wbv

Killing

Stopping container istio-proxy
(x3)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-lsz2g

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes
(x11)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6fec8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x11)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6fec8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

Unhealthy

Startup probe failed: Get "http://10.134.1.75:15021/healthz/ready": dial tcp 10.134.1.75:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

ProbeError

Startup probe error: Get "http://10.134.1.75:15021/healthz/ready": dial tcp 10.134.1.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-rk5k5
(x2)

openshift-ingress

kubelet

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-27vg6
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

ProbeError

Readiness probe error: Get "http://10.134.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Unhealthy

Readiness probe failed: Get "http://10.134.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 4 to 3

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-d6gzl

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x5)

openshift-ingress

kubelet

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

ProbeError

Startup probe error: Get "http://10.132.1.59:15021/healthz/ready": dial tcp 10.132.1.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

Unhealthy

Startup probe failed: Get "http://10.132.1.59:15021/healthz/ready": dial tcp 10.132.1.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b4971a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

ProbeError

Startup probe error: Get "http://10.134.1.71:15021/healthz/ready": dial tcp 10.134.1.71:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b4971a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Unhealthy

Startup probe failed: Get "http://10.134.1.71:15021/healthz/ready": dial tcp 10.134.1.71:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

AddedInterface

Add eth0 [10.134.1.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b4971a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b4971a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

Unhealthy

Startup probe failed: Get "http://10.134.1.85:15021/healthz/ready": dial tcp 10.134.1.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

ProbeError

Startup probe error: Get "http://10.134.1.85:15021/healthz/ready": dial tcp 10.134.1.85:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5dab6a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5dab6a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-nccrq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 5 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulDelete

Deleted pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-mxvfl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qrq8j

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

AddedInterface

Add eth0 [10.134.1.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-pm4c4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Unhealthy

Startup probe failed: Get "http://10.134.1.86:15021/healthz/ready": dial tcp 10.134.1.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

ProbeError

Startup probe error: Get "http://10.134.1.86:15021/healthz/ready": dial tcp 10.134.1.86:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-737bf2d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-737bf2d8

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

openshift-ingress

deployment-controller

e2e-mt-737bf2d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-737bf2d8-openshift-default-56dc96b957 from 0 to 1

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

AddedInterface

Add eth0 [10.134.1.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-737bf2d8-66d45589cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-737bf2d8: serviceaccount "payload-processing-e2e-mt-737bf2d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-737bf2d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-737bf2d8-66d45589cc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-737bf2d8-66d45589cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-737bf2d8-66d45589cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-737bf2d8: serviceaccount "payload-processing-e2e-mt-737bf2d8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-737bf2d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-737bf2d8-6ff985b587 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l

AddedInterface

Add eth0 [10.134.1.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc

AddedInterface

Add eth0 [10.134.1.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ee618c-7bc658cb5-2kgml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-ssz95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zm4z7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-zgdl8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-smljd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-4tt4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-vhjlx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-x8tb9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-c4jpz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ee618c-8bc685f5f-l65d9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-z4qxq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-ee618c-openshift-default-5ff9c74dc9-gvmnj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5bfc51-86f8495ff9-wgnll

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-5bfc51-openshift-default-54d8846889-sc6sj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5bfc51-6c7fc6b99f-kdhcn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w4-4a697f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5

SuccessfulDelete

Deleted pod: e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-7hhxt

openshift-ingress

deployment-controller

e2e-shared-b-w3-556c14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-556c14-openshift-default-754b5bc799 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-556c14-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-556c14-openshift-default-754b5bc799

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-x67zh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

AddedInterface

Add eth0 [10.134.1.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-mt-737bf2d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-737bf2d8-openshift-default-56dc96b957 from 1 to 4

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

AddedInterface

Add eth0 [10.132.1.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Created

Container created

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Created

Container created

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulDelete

Deleted pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Started

Container started

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Started

Container started

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-650be0-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-3c5983-openshift-default-86c5bc855c

SuccessfulDelete

Deleted pod: e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

openshift-ingress

replicaset-controller

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9

SuccessfulDelete

Deleted pod: e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-650be0-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-af8244-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-3c5983-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-3c5983-openshift-default-86c5bc855c from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-jtjq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-extmod-b-af8244-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-af8244-openshift-default-594d5d565c from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3c5983-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-9gm5g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-af8244-openshift-default-594d5d565c

SuccessfulDelete

Deleted pod: e2e-extmod-b-af8244-openshift-default-594d5d565c-l4j5c

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Unhealthy

Readiness probe failed: Get "http://10.134.1.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

ProbeError

Readiness probe error: Get "http://10.134.1.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-5ww48
(x2)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

ProbeError

Startup probe error: Get "http://10.132.1.74:15021/healthz/ready": dial tcp 10.132.1.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Unhealthy

Startup probe failed: Get "http://10.132.1.74:15021/healthz/ready": dial tcp 10.132.1.74:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w4-6c0ec0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-6c0ec0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-8hz7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulDelete

Deleted pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-wxr6x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-qlgb7

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Unhealthy

Startup probe failed: Get "http://10.134.1.93:15021/healthz/ready": dial tcp 10.134.1.93:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-ddd653-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ddd653-openshift-default-779ff6465 from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

ProbeError

Startup probe error: Get "http://10.134.1.93:15021/healthz/ready": dial tcp 10.134.1.93:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-50e623-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-50e623-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-shared-a-w0-50e623-openshift-default-6c86dc794f from 3 to 2

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-jmfmb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ddd653-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-ddd653-openshift-default-779ff6465

SuccessfulDelete

Deleted pod: e2e-extmod-a-ddd653-openshift-default-779ff6465-6hnrl

openshift-ingress

deployment-controller

e2e-shared-b-w0-020af9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-020af9-openshift-default-d77df45d5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-020af9-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-020af9-openshift-default-d77df45d5

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-vjg9x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-027c19-openshift-default-58d5bc7645

SuccessfulDelete

Deleted pod: e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

openshift-ingress

deployment-controller

e2e-extmod-a-027c19-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-027c19-openshift-default-58d5bc7645 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-ss9cd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-027c19-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-6jphv

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

ProbeError

Startup probe error: Get "http://10.134.1.89:15021/healthz/ready": dial tcp 10.134.1.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Unhealthy

Startup probe failed: Get "http://10.134.1.89:15021/healthz/ready": dial tcp 10.134.1.89:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulDelete

Deleted pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-k87gb

openshift-ingress

deployment-controller

e2e-extmod-b-e1f08d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9

SuccessfulDelete

Deleted pod: e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1f08d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-tljzc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-5xzz5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f9a3a-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x4)

openshift-ingress

deployment-controller

e2e-worker-w0-2f9a3a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97 from 3 to 2
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-dxffl
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b6afd6-786d97f6c5-cndzr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-sjhcb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

AddedInterface

Add eth0 [10.132.1.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

AddedInterface

Add eth0 [10.132.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-mt-737bf2d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-737bf2d8-openshift-default-56dc96b957 from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

AddedInterface

Add eth0 [10.134.1.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Created

Container created

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Created

Container created

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Started

Container started

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Created

Container created

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Started

Container started

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Started

Container started

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Created

Container created

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

ProbeError

Startup probe error: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

ProbeError

Startup probe error: Get "http://10.132.1.76:15021/healthz/ready": dial tcp 10.132.1.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Unhealthy

Startup probe failed: Get "http://10.132.1.76:15021/healthz/ready": dial tcp 10.132.1.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

ProbeError

Startup probe error: Get "http://10.134.1.96:15021/healthz/ready": dial tcp 10.134.1.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Unhealthy

Startup probe failed: Get "http://10.134.1.96:15021/healthz/ready": dial tcp 10.134.1.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Unhealthy

Startup probe failed: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-b6afd6-openshift-default-78d46d7dcc-dg79z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b4971a-558c5458f5-jn77t

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b6afd6-7db7d566cf-rkxmr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-mt-737bf2d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-737bf2d8-openshift-default-56dc96b957 from 8 to 9

openshift-ingress

replicaset-controller

e2e-mt-737bf2d8-openshift-default-56dc96b957

SuccessfulCreate

Created pod: e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-737bf2d8-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Started

Container started

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-d25759-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-d25759-openshift-default-d47fd9785 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d25759-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-d25759-openshift-default-d47fd9785

SuccessfulDelete

Deleted pod: e2e-extmod-a-d25759-openshift-default-d47fd9785-jcn5l

openshift-ingress

kubelet

e2e-inf-b-b4971a-openshift-default-5dc48765-8rn6x

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-737bf2d8-66d45589cc-n7m7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-737bf2d8-6ff985b587-vb7qc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b4971a-6c58f96447-rjn8w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-6fec8a-openshift-default-5cc5f9b957-p9mtp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-9v2m2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vswqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-njbxm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-rhc89

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-n7chn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6fec8a-55b98d9959-lspsj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-vhvf6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6fec8a-c89f98cff-l8txh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-jhxgw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-mwnjn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-737bf2d8-openshift-default-56dc96b957-b5cbp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

Unhealthy

Startup probe failed: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

ProbeError

Startup probe error: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ddd653-5764b8bfbc-fcxrz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ddd653-84dfd5bd67-wv882

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-531447-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-531447-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5dab6a-6c4b59c89-txkqj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5dab6a-57cf987799-9svqc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-jvqst

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-jvqst

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

openshift-ingress

deployment-controller

e2e-shared-a-w2-531447-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-531447-openshift-default-7995d46767 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-531447-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

AddedInterface

Add eth0 [10.132.1.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

AddedInterface

Add eth0 [10.134.1.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-5dab6a-openshift-default-6ff495656c-bxn8s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-ddd653-openshift-default-779ff6465-t9cvw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

ProbeError

Startup probe error: Get "http://10.134.1.101:15021/healthz/ready": dial tcp 10.134.1.101:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Unhealthy

Startup probe failed: Get "http://10.134.1.101:15021/healthz/ready": dial tcp 10.134.1.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Unhealthy

Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

ProbeError

Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Unhealthy

Startup probe failed: Get "http://10.132.1.79:15021/healthz/ready": dial tcp 10.132.1.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

ProbeError

Startup probe error: Get "http://10.132.1.79:15021/healthz/ready": dial tcp 10.132.1.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-531447-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-531447-openshift-default-7995d46767 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-531447-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

AddedInterface

Add eth0 [10.134.1.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

AddedInterface

Add eth0 [10.132.1.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

AddedInterface

Add eth0 [10.132.1.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

ProbeError

Startup probe error: Get "http://10.134.1.102:15021/healthz/ready": dial tcp 10.134.1.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Unhealthy

Startup probe failed: Get "http://10.134.1.102:15021/healthz/ready": dial tcp 10.134.1.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Unhealthy

Startup probe failed: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

ProbeError

Startup probe error: Get "http://10.132.1.80:15021/healthz/ready": dial tcp 10.132.1.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Unhealthy

Startup probe failed: Get "http://10.132.1.81:15021/healthz/ready": dial tcp 10.132.1.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

ProbeError

Startup probe error: Get "http://10.132.1.81:15021/healthz/ready": dial tcp 10.132.1.81:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-be59df-c7b8b85f5-vzcvs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-be59df-bb748fd99-jzkdj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-be59df-openshift-default-6764f766d9-qhdnv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-531447-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

e2e-shared-a-w2-531447-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-531447-openshift-default-7995d46767 from 8 to 10

openshift-ingress

replicaset-controller

e2e-shared-a-w2-531447-openshift-default-7995d46767

SuccessfulCreate

Created pod: e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

AddedInterface

Add eth0 [10.134.1.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

ProbeError

Startup probe error: Get "http://10.134.1.105:15021/healthz/ready": dial tcp 10.134.1.105:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Unhealthy

Startup probe failed: Get "http://10.134.1.105:15021/healthz/ready": dial tcp 10.134.1.105:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-50e623-6d6668784c-kp496

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-50e623-746d8fcf47-tjbwb

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-96hvv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-50e623-openshift-default-6c86dc794f-4mplg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-020af9-openshift-default-d77df45d5-mpgn5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-020af9-66449c479f-bmnx4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-020af9-7fcf787fd7-9fgx6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f9a3a-78c44fb86c-ckvcs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f9a3a-8697684787-rcsf2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-6mh8b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f9a3a-openshift-default-7f6f74cf97-xmmdd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

AddedInterface

Add eth0 [10.134.1.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

Unhealthy

Startup probe failed: Get "http://10.134.1.110:15021/healthz/ready": dial tcp 10.134.1.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

ProbeError

Startup probe error: Get "http://10.134.1.110:15021/healthz/ready": dial tcp 10.134.1.110:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

AddedInterface

Add eth0 [10.134.1.114/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-ef434a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef434a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc

SuccessfulCreate

Created pod: e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

Unhealthy

Startup probe failed: Get "http://10.134.1.114:15021/healthz/ready": dial tcp 10.134.1.114:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

ProbeError

Startup probe error: Get "http://10.134.1.114:15021/healthz/ready": dial tcp 10.134.1.114:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7037-98d1a5

Created

Container created

opendatahub

kubelet

test-curl-7037-98d1a5

Started

Container started

opendatahub

kubelet

test-curl-7037-98d1a5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7037-98d1a5

AddedInterface

Add eth0 [10.132.1.83/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7037-1655dd

Started

Container started

opendatahub

kubelet

test-curl-7037-1655dd

Created

Container created

opendatahub

kubelet

test-curl-7037-1655dd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7037-1655dd

AddedInterface

Add eth0 [10.132.1.84/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7037-98d1a5

Killing

Stopping container test-curl-7037-98d1a5

opendatahub

kubelet

test-curl-7037-1655dd

Killing

Stopping container test-curl-7037-1655dd

openshift-ingress

kubelet

e2e-extmod-a-027c19-openshift-default-58d5bc7645-zjnf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-027c19-67b548955-rltd2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-027c19-596c6c9695-wm55p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-717217-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-717217-openshift-default-578c69554c

SuccessfulCreate

Created pod: e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

deployment-controller

e2e-shared-a-w3-717217-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-shared-a-w3-717217-openshift-default-578c69554c from 1 to 2

openshift-ingress

multus

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

AddedInterface

Add eth0 [10.132.1.85/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-6c0ec0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc

SuccessfulCreate

Created pod: e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-3c5983-openshift-default-86c5bc855c-2hx8m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

deployment-controller

e2e-shared-b-w4-4a697f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5 from 1 to 2
(x2)

openshift-ingress

deployment-controller

e2e-shared-a-w4-6c0ec0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5

SuccessfulCreate

Created pod: e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

AddedInterface

Add eth0 [10.134.1.119/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

AddedInterface

Add eth0 [10.132.1.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

Started

Container started
(x2)

openshift-ingress

deployment-controller

e2e-shared-b-w3-556c14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-556c14-openshift-default-754b5bc799 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-556c14-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-556c14-openshift-default-754b5bc799

SuccessfulCreate

Created pod: e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

Created

Container created

openshift-ingress

multus

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

AddedInterface

Add eth0 [10.134.1.121/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

ProbeError

Startup probe error: Get "http://10.132.1.85:15021/healthz/ready": dial tcp 10.132.1.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

Unhealthy

Startup probe failed: Get "http://10.132.1.85:15021/healthz/ready": dial tcp 10.132.1.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

Unhealthy

Startup probe failed: Get "http://10.132.1.86:15021/healthz/ready": dial tcp 10.132.1.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

Unhealthy

Startup probe failed: Get "http://10.134.1.119:15021/healthz/ready": dial tcp 10.134.1.119:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

ProbeError

Startup probe error: Get "http://10.134.1.119:15021/healthz/ready": dial tcp 10.134.1.119:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3c5983-7fbf586cf5-92rtm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

ProbeError

Startup probe error: Get "http://10.132.1.86:15021/healthz/ready": dial tcp 10.132.1.86:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3c5983-564977cd99-qs5fk

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.216:50052" within 1s: context deadline exceeded
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

ProbeError

Startup probe error: Get "http://10.134.1.121:15021/healthz/ready": dial tcp 10.134.1.121:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

Unhealthy

Startup probe failed: Get "http://10.134.1.121:15021/healthz/ready": dial tcp 10.134.1.121:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-5ws4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gfccz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcsn2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-tlggp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-c9sjv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-gb65r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-l2qth

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-4xqgj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jcnlj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-531447-openshift-default-7995d46767-jpz2z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-531447-7cf7bc4dcf-xt4bm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-531447-667d774bfc-9shwq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d25759-5587dc5df9-tl5d6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-7c759a-openshift-default-56576554df-wkcvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-d2znx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-ef434a-openshift-default-67cd7c96dc-q5p6d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w1-4af1f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-4af1f7-openshift-default-745ff98565 from 1 to 2

openshift-ingress

multus

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

AddedInterface

Add eth0 [10.134.1.125/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-4af1f7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565

SuccessfulCreate

Created pod: e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-7gzj2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-d25759-openshift-default-d47fd9785-zxs8d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-7c759a-7745bc7499-bmfl4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-7c759a-66695c8d79-7ws2z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-b-w4-4a697f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5 from 2 to 3

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-4a697f-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5

SuccessfulCreate

Created pod: e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef434a-7b64fdc54f-9zxp5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef434a-845d4b6b99-nqmzg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

ProbeError

Startup probe error: Get "http://10.134.1.125:15021/healthz/ready": dial tcp 10.134.1.125:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

Unhealthy

Startup probe failed: Get "http://10.134.1.125:15021/healthz/ready": dial tcp 10.134.1.125:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-57079b-openshift-default-5c84d8878f-drtdm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d25759-857574b47-bpmv4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-e1f08d-openshift-default-6b4b5fc8b9-dg98g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-57079b-5f4958f857-v8cxd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-57079b-666f95c947-dv7mr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1f08d-f5fb4c64f-mmvp6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-f7680d-59ddf48c45-8xgwl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-kxj54

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-f7680d-67845fdfd7-r56nd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-6c0ec0-openshift-default-79c7584bfc-gh5gs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-mwwv6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-f7680d-openshift-default-c4488d5c9

SuccessfulCreate

Created pod: e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1f08d-597cb67847-6rjh6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x8)

openshift-ingress

deployment-controller

e2e-worker-w2-f7680d-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w2-f7680d-openshift-default-c4488d5c9 from 2 to 3

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-f7680d-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-6c0ec0-7474bf5fc5-dhqxc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-717217-openshift-default-578c69554c-n9hbd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-6c0ec0-65c5d46767-hsxz4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

Unhealthy

Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

ProbeError

Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-qn8tj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-79hdz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-4a697f-openshift-default-666db9f8f5-bx28n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-d7cxr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-qstvv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-f7680d-openshift-default-c4488d5c9-2fkgc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-717217-54d8c4bcf-v8j62

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-dt7h4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-556c14-openshift-default-754b5bc799-fqqx7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-717217-5f86cd4989-6685p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-4a697f-94d8d8fc9-kzr29

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-4a697f-79fb8d7d9-gr8cv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-bv95q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-821f5a-openshift-default-7bfc657d9-z6zqz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-lsz2g

openshift-ingress

replicaset-controller

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc

SuccessfulCreate

Created pod: e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-556c14-669d5fb59f-cjtpf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-596dc9545f-fjz5c

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-596dc9545f from 10 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-shared-a-w1-2729f2-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-2729f2-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

AddedInterface

Add eth0 [10.132.1.87/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-fjz5c

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-556c14-566c7cc65c-lcbl4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-lsz2g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

ProbeError

Startup probe error: Get "http://10.132.1.87:15021/healthz/ready": dial tcp 10.132.1.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

Unhealthy

Startup probe failed: Get "http://10.132.1.87:15021/healthz/ready": dial tcp 10.132.1.87:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-821f5a-7655cbb57c-wgbsw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-821f5a-84858c594c-pszhq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-af8244-openshift-default-594d5d565c-4f5nx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-650be0-58fc9b6455-9jl7f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-650be0-86d95657b7-vm62r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-af8244-84f67c568c-m9kgf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-83755a-7dfdb9c56c-l78nm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-af8244-75d9474dd7-pr6cd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-83755a-67c54f67f5-mxhfv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-nzh65

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-650be0-openshift-default-5c7c5fb7d9-84qlq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-ztm5t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-j28rg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-2729f2-openshift-default-9fb97b4fc-6jhb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-64j8w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

openshift-ingress

replicaset-controller

e2e-worker-w3-83755a-openshift-default-c86f9565c

SuccessfulCreate

Created pod: e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-x9v2k

AddedInterface

Add eth0 [10.132.1.88/23] from ovn-kubernetes
(x4)

openshift-ingress

deployment-controller

e2e-worker-w3-83755a-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w3-83755a-openshift-default-c86f9565c from 2 to 4

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-83755a-openshift-default-c86f9565c-vm5n9

AddedInterface

Add eth0 [10.132.1.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-83755a-openshift-default-c86f9565c-mlxvq

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-83755a-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-ktw4m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-4af1f7-openshift-default-745ff98565-67sww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-2729f2-558f777dc-9gclz

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.168:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-2729f2-565847c555-wqvj7

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.169:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-4af1f7-7fc8d84d47-mp2bh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-4af1f7-7cc74c488c-tsnxd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

AddedInterface

Add eth0 [10.132.1.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

ProbeError

Startup probe error: Get "http://10.132.1.92:15021/healthz/ready": dial tcp 10.132.1.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

Unhealthy

Startup probe failed: Get "http://10.132.1.92:15021/healthz/ready": dial tcp 10.132.1.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-88bbf7-openshift-default-574f47fff7

SuccessfulCreate

Created pod: e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

AddedInterface

Add eth0 [10.132.1.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-88bbf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-88bbf7-openshift-default-574f47fff7 from 3 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-88bbf7-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-88bbf7-554c5df5-dxctw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-88bbf7-78b86696f9-x7mgb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

ProbeError

Startup probe error: Get "http://10.132.1.93:15021/healthz/ready": dial tcp 10.132.1.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

Unhealthy

Startup probe failed: Get "http://10.132.1.93:15021/healthz/ready": dial tcp 10.132.1.93:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-6qqxz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-x96kz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-h9mjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-88bbf7-openshift-default-574f47fff7-sbh4l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ait-a932d7e1-openshift-default-994d78cb5

SuccessfulCreate

Created pod: e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

openshift-ingress

deployment-controller

e2e-ait-a932d7e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a932d7e1-openshift-default-994d78cb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a932d7e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a932d7e1

openshift-ingress

multus

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

AddedInterface

Add eth0 [10.132.1.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a932d7e1-5dff9b7b87

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a932d7e1: serviceaccount "payload-processing-e2e-ait-a932d7e1" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a932d7e1-5dff9b7b87

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a932d7e1-5dff9b7b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a932d7e1: serviceaccount "payload-processing-e2e-ait-a932d7e1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a932d7e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a932d7e1-5dff9b7b87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a932d7e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6

AddedInterface

Add eth0 [10.132.1.96/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

AddedInterface

Add eth0 [10.132.1.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

ProbeError

Startup probe error: Get "http://10.132.1.94:15021/healthz/ready": dial tcp 10.132.1.94:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Unhealthy

Startup probe failed: Get "http://10.132.1.94:15021/healthz/ready": dial tcp 10.132.1.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-a932d7e1-5dff9b7b87-wf7p6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a932d7e1-5c58fb7f-7xzkk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a932d7e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a932d7e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Killing

Stopping container istio-proxy

opendatahub

replicaset-controller

maas-controller-7b85f9594f

SuccessfulDelete

Deleted pod: maas-controller-7b85f9594f-9gw68

opendatahub

kubelet

maas-controller-7b85f9594f-9gw68

Killing

Stopping container manager

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-a932d7e1-openshift-default-994d78cb5-qwmlw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

maas-controller-7b85f9594f

SuccessfulCreate

Created pod: maas-controller-7b85f9594f-vwbsl

opendatahub

kubelet

maas-controller-7b85f9594f-vwbsl

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da"

opendatahub

kubelet

maas-controller-7b85f9594f-vwbsl

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da" in 882ms (883ms including waiting). Image size: 200104981 bytes.

opendatahub

multus

maas-controller-7b85f9594f-vwbsl

AddedInterface

Add eth0 [10.132.1.98/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7b85f9594f-vwbsl

Created

Container created

opendatahub

kubelet

maas-controller-7b85f9594f-vwbsl

Started

Container started

opendatahub

maas-controller-7b85f9594f-vwbsl_1af30cc3-7a88-4415-9b8c-7b967804eca3

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7b85f9594f-vwbsl_1af30cc3-7a88-4415-9b8c-7b967804eca3 became leader
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-596dc9545f from 8 to 10
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-7kxj4

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-7kxj4

AddedInterface

Add eth0 [10.132.1.100/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ptjsj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-7kxj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-596dc9545f

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-596dc9545f-ptjsj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-7kxj4

Created

Container created

opendatahub

kubelet

maas-controller-7b85f9594f-vwbsl

Killing

Stopping container manager

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-7kxj4

Started

Container started

opendatahub

replicaset-controller

maas-controller-7b85f9594f

SuccessfulDelete

Deleted pod: maas-controller-7b85f9594f-vwbsl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ptjsj

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-596dc9545f-ptjsj

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ptjsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7b85f9594f from 1 to 0
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7b85f9594f from 0 to 1

opendatahub

replicaset-controller

maas-controller-7b85f9594f

SuccessfulCreate

Created pod: maas-controller-7b85f9594f-xg8nb

opendatahub

multus

maas-controller-7b85f9594f-xg8nb

AddedInterface

Add eth0 [10.132.1.101/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7b85f9594f-xg8nb

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da"

opendatahub

kubelet

maas-controller-7b85f9594f-xg8nb

Created

Container created

opendatahub

kubelet

maas-controller-7b85f9594f-xg8nb

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:05734af84c91f016696a07e42436576ebd766ca9a34a290bac59aa56ba8c98da" in 487ms (487ms including waiting). Image size: 200104981 bytes.

opendatahub

kubelet

maas-controller-7b85f9594f-xg8nb

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-7kxj4

Unhealthy

Startup probe failed: Get "http://10.132.1.100:15021/healthz/ready": dial tcp 10.132.1.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-7kxj4

ProbeError

Startup probe error: Get "http://10.132.1.100:15021/healthz/ready": dial tcp 10.132.1.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ptjsj

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-ptjsj

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused

opendatahub

maas-controller-7b85f9594f-xg8nb_26f4f346-1e7d-49c3-a761-322d275d4abf

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7b85f9594f-xg8nb_26f4f346-1e7d-49c3-a761-322d275d4abf became leader

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-mktb8

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mktb8

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.Secret llm/e2e-prio-pool-55b7e383-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.Deployment llm/e2e-prio-pool-55b7e383-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.ServiceAccount llm/e2e-prio-pool-55b7e383-epp-sa

llm

deployment-controller

e2e-prio-pool-55b7e383-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-55b7e383-kserve-7968bccd9f from 0 to 1

llm

deployment-controller

e2e-prio-pool-55b7e383-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.RoleBinding llm/e2e-prio-pool-55b7e383-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.Role llm/e2e-prio-pool-55b7e383-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.Deployment llm/e2e-prio-pool-55b7e383-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-55b7e383-epp-auth-rb

llm

replicaset-controller

e2e-prio-pool-55b7e383-kserve-7968bccd9f

SuccessfulCreate

Created pod: e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.Service llm/e2e-prio-pool-55b7e383-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

Created v1.Service llm/e2e-prio-pool-55b7e383-epp-service

llm

replicaset-controller

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54

SuccessfulCreate

Created pod: e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

llm

kubelet

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

AddedInterface

Add eth0 [10.132.1.107/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

Started

Container started

llm

kubelet

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

Created

Container created

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-55b7e383-kserve-route

llm

multus

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

AddedInterface

Add eth0 [10.132.1.108/23] from ovn-kubernetes
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-55b7e383-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Started

Container started

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Created

Container created

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 4.041s (4.041s including waiting). Image size: 184206420 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Updated

Updated v1.Secret llm/e2e-prio-pool-55b7e383-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-55b7e383] is Ready

llm

kubelet

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

Killing

Stopping container main

llm

LLMInferenceServiceController

e2e-prio-pool-55b7e383

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-55b7e383-epp-auth-rb

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Killing

Stopping container main

openshift-ingress

deployment-controller

e2e-worker-single-main-515c8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-515c8f-openshift-default-67c66d4ffc from 0 to 1

llm

kubelet

e2e-prio-pool-55b7e383-kserve-7968bccd9f-5w5g8

Unhealthy

Readiness probe failed: Get "https://10.132.1.107:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffc

SuccessfulCreate

Created pod: e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

openshift-ingress

multus

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

AddedInterface

Add eth0 [10.134.1.136/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-515c8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-515c8f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-515c8f: serviceaccount "payload-processing-e2e-worker-single-main-515c8f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-515c8f-7865858787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-515c8f-7865858787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-515c8f: serviceaccount "payload-processing-e2e-worker-single-main-515c8f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-515c8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-515c8f-7865858787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-515c8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-515c8f-7865858787 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

AddedInterface

Add eth0 [10.134.1.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

AddedInterface

Add eth0 [10.134.1.138/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-gw8mh

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gw8mh

Killing

Stopping container discovery
(x12)

openshift-ingress

kubelet

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

ProbeError

Startup probe error: Get "http://10.134.1.136:15021/healthz/ready": dial tcp 10.134.1.136:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

Unhealthy

Startup probe failed: Get "http://10.134.1.136:15021/healthz/ready": dial tcp 10.134.1.136:15021: connect: connection refused
(x4)

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

llm

kubelet

e2e-prio-pool-55b7e383-kserve-router-scheduler-57bb946f54-zt76n

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.108:9003" within 1s: context deadline exceeded
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-515c8f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-515c8f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vzmt5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcx7mrg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-515c8f-7865858787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-515c8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-515c8f: serviceaccount "payload-processing-e2e-worker-single-main-515c8f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-515c8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-515c8f-7865858787 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-515c8f-7865858787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-515c8f-7865858787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-515c8f: serviceaccount "payload-processing-e2e-worker-single-main-515c8f" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

AddedInterface

Add eth0 [10.132.1.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

AddedInterface

Add eth0 [10.134.1.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-515c8f-78658vth74

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-515c8f-5bc5b95bcmfzbh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-515c8f-openshift-default-67c66d4ffcdz4nw

Killing

Stopping container istio-proxy

llm

replicaset-controller

e2e-same-id-a-077b6796-kserve-55c58b6bcc

SuccessfulCreate

Created pod: e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.Deployment llm/e2e-same-id-a-077b6796-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.HTTPRoute llm/e2e-same-id-a-077b6796-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.DestinationRule llm/e2e-same-id-a-077b6796-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.PodMonitor llm/e2e-same-id-a-077b6796-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.PodMonitor llm/e2e-same-id-a-077b6796-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.Secret llm/e2e-same-id-a-077b6796-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-077b6796-prometheus-scraping

llm

deployment-controller

e2e-same-id-a-077b6796-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-077b6796-kserve-55c58b6bcc from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Created

Created v1.Service llm/e2e-same-id-a-077b6796-kserve-workload-svc

llm

kubelet

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

Created

Container created

llm

kubelet

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

Started

Container started

llm

kubelet

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

AddedInterface

Add eth0 [10.132.1.112/23] from ovn-kubernetes
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

Updated

Updated v1.Secret llm/e2e-same-id-a-077b6796-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-077b6796] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.Deployment llm/e2e-same-id-b-077b6796-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.DestinationRule llm/e2e-same-id-b-077b6796-kserve-workload-svc

llm

replicaset-controller

e2e-same-id-b-077b6796-kserve-58584d646f

SuccessfulCreate

Created pod: e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

llm

deployment-controller

e2e-same-id-b-077b6796-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-077b6796-kserve-58584d646f from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.Secret llm/e2e-same-id-b-077b6796-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.HTTPRoute llm/e2e-same-id-b-077b6796-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.Service llm/e2e-same-id-b-077b6796-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.PodMonitor llm/e2e-same-id-b-077b6796-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.PodMonitor llm/e2e-same-id-b-077b6796-kserve-llmisvc-engine

llm

kubelet

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-077b6796-prometheus-scraping

llm

kubelet

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

Created

Container created

llm

multus

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

AddedInterface

Add eth0 [10.134.1.142/23] from ovn-kubernetes
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

Updated

Updated v1.Secret llm/e2e-same-id-b-077b6796-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-077b6796] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-077b6796

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-077b6796 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-077b6796; safe to ignore if traffic splitting is planned
(x8)

llm

LLMInferenceServiceController

e2e-same-id-b-077b6796

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-077b6796 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-077b6796; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

Killing

Stopping container main

llm

kubelet

e2e-same-id-a-077b6796-kserve-55c58b6bcc-6rs9p

Unhealthy

Readiness probe failed: Get "https://10.132.1.112:8000/ready": dial tcp 10.132.1.112:8000: connect: connection refused

llm

kubelet

e2e-same-id-b-077b6796-kserve-58584d646f-45vkg

Unhealthy

Readiness probe failed: Get "https://10.134.1.142:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-5f985d8646

SuccessfulCreate

Created pod: payload-pre-processing-5f985d8646-z5mcb

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-5f985d8646 from 0 to 1

openshift-ingress

multus

payload-pre-processing-5f985d8646-z5mcb

AddedInterface

Add eth0 [10.134.1.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-5f985d8646-z5mcb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-5f985d8646-z5mcb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-5f985d8646-z5mcb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6q4gn

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-6q4gn

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-76c78d77d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-76c78d77d6-zpncn

Started

Container started

openshift-ingress

kubelet

payload-processing-76c78d77d6-zpncn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-76c78d77d6

SuccessfulCreate

Created pod: payload-processing-76c78d77d6-zpncn

openshift-ingress

kubelet

payload-processing-76c78d77d6-zpncn

Created

Container created

openshift-ingress

multus

payload-processing-76c78d77d6-zpncn

AddedInterface

Add eth0 [10.134.1.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-qvj7w

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-qvj7w

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

kubelet

payload-processing-754bb5cbcf-77zpm

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59b8dd6b64 from 0 to 1

openshift-ingress

kubelet

payload-processing-754bb5cbcf-77zpm

Started

Container started

openshift-ingress

multus

payload-processing-754bb5cbcf-77zpm

AddedInterface

Add eth0 [10.132.1.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-754bb5cbcf-77zpm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-754bb5cbcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-754bb5cbcf

SuccessfulCreate

Created pod: payload-processing-754bb5cbcf-77zpm

openshift-ingress

replicaset-controller

payload-pre-processing-59b8dd6b64

SuccessfulCreate

Created pod: payload-pre-processing-59b8dd6b64-jcv9p

openshift-ingress

kubelet

payload-pre-processing-59b8dd6b64-jcv9p

Started

Container started

openshift-ingress

multus

payload-pre-processing-59b8dd6b64-jcv9p

AddedInterface

Add eth0 [10.132.1.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59b8dd6b64-jcv9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-59b8dd6b64-jcv9p

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-5f985d8646

SuccessfulDelete

Deleted pod: payload-pre-processing-5f985d8646-z5mcb

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-5f985d8646 from 1 to 0

openshift-ingress

kubelet

payload-processing-76c78d77d6-zpncn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-76c78d77d6 from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-76c78d77d6

SuccessfulDelete

Deleted pod: payload-processing-76c78d77d6-zpncn

openshift-ingress

kubelet

payload-pre-processing-5f985d8646-z5mcb

Killing

Stopping container payload-pre-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-m85fl
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-m85fl

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-m85fl

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5bcd7997-m85fl

AddedInterface

Add eth0 [10.132.1.115/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-m85fl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-76c78d77d6-zpncn

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.1.147:50052" within 1s: context deadline exceeded

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-m85fl

Killing

Stopping container payload-processing

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mpgsb

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 580ms (580ms including waiting). Image size: 247676581 bytes.
(x2)

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mpgsb

Created

Container created
(x2)

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mpgsb

Started

Container started
(x2)

opendatahub

kubelet

kserve-controller-manager-776cc66d47-mpgsb

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

openshift-jobset-operator

kubelet

jobset-controller-manager-6f98fffc9c-l2ptp

BackOff

Back-off restarting failed container manager in pod jobset-controller-manager-6f98fffc9c-l2ptp_openshift-jobset-operator(4d579ceb-59fa-499a-b241-7f4e940976c3)

opendatahub

kserve-controller-manager-776cc66d47-mpgsb_f2193f64-8dae-4b79-9d9d-9a14f2f583d9

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-mpgsb_f2193f64-8dae-4b79-9d9d-9a14f2f583d9 became leader
(x2)

openshift-jobset-operator

kubelet

jobset-controller-manager-6f98fffc9c-l2ptp

Pulled

Container image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" already present on machine and can be accessed by the pod
(x3)

openshift-jobset-operator

kubelet

jobset-controller-manager-6f98fffc9c-l2ptp

Created

Container created
(x3)

openshift-jobset-operator

kubelet

jobset-controller-manager-6f98fffc9c-l2ptp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-single-main-7fde87-openshift-default-5f8558df65

SuccessfulCreate

Created pod: e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-7fde87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-7fde87

openshift-ingress

deployment-controller

e2e-worker-single-main-7fde87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-7fde87-openshift-default-5f8558df65 from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

AddedInterface

Add eth0 [10.132.1.116/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-7fde87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-7fde87-6b96867c89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-7fde87-6b96867c89

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7fde87: serviceaccount "payload-processing-e2e-worker-single-main-7fde87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-7fde87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-7fde87-6b96867c89

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-7fde87-6b96867c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7fde87: serviceaccount "payload-processing-e2e-worker-single-main-7fde87" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

AddedInterface

Add eth0 [10.132.1.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

AddedInterface

Add eth0 [10.134.1.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

Created

Container created

openshift-jobset-operator

jobset-controller-manager-6f98fffc9c-l2ptp_5b18964d-3de0-47f7-b94f-7c16b830effe

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-6f98fffc9c-l2ptp_5b18964d-3de0-47f7-b94f-7c16b830effe became leader
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

Unhealthy

Startup probe failed: Get "http://10.132.1.116:15021/healthz/ready": dial tcp 10.132.1.116:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

ProbeError

Startup probe error: Get "http://10.132.1.116:15021/healthz/ready": dial tcp 10.132.1.116:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-7fde87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-7fde87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8jxctp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5wmrlg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-7fde87-6b96867c89

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-7fde87-6b96867c89

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-7fde87-6b96867c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7fde87: serviceaccount "payload-processing-e2e-worker-single-main-7fde87" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-7fde87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-7fde87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-7fde87-6b96867c89 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-7fde87-7b7c584bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-7fde87: serviceaccount "payload-processing-e2e-worker-single-main-7fde87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd

AddedInterface

Add eth0 [10.134.1.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-7fde87-6b96867c8lcmpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-7fde87-7b7c5lgrsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-7fde87-openshift-default-5f8558df65m5nbx

Killing

Stopping container istio-proxy

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-7zsk9

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7zsk9

Killing

Stopping container manager

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-btqdp

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-btqdp

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-btqdp

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-btqdp
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-btqdp

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-btqdp_877dadf1-12b9-48a7-9b09-c0abf2f5bace

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-btqdp_877dadf1-12b9-48a7-9b09-c0abf2f5bace became leader
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-v5p6s

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-s4dc8

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-d852p

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

Unhealthy

Readiness probe failed: Get "http://10.133.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-46hnd

ProbeError

Readiness probe error: Get "http://10.133.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-q5n9x

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-9jvbb

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

ProbeError

Readiness probe error: Get "http://10.132.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-596dc9545f-vm5w5

Unhealthy

Readiness probe failed: Get "http://10.132.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)