Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc to ip-10-0-136-97.ec2.internal

ai-tenants

e2e-api-a-3b93b5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-3b93b5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-f247d1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-f247d1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-3e4daf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-3e4daf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-cc0859

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-cc0859: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-d4b0d5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-d4b0d5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-dbed6d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-dbed6d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-75c2b0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-75c2b0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-398c25

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-398c25: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-441461

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-441461: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-689bcf

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-689bcf: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-9d8692

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-9d8692: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-e10c0f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-e10c0f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-35f43f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-35f43f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-372480

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-372480: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-81afe3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-81afe3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-855e14

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-855e14: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-93b821

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-93b821: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-0393ed

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-0393ed: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-3cfed7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-3cfed7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-a3d585

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-a3d585: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-ae0e75

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-ae0e75: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-d53363

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-d53363: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-35fc87

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-35fc87: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-4206d9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-4206d9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-9e0d09

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-9e0d09: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq to ip-10-0-134-92.ec2.internal

ai-tenants

e2e-inf-b-e84013

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-e84013: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-04fdf3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-04fdf3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-499bca

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-499bca: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-6c106c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-6c106c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-d6c536

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-d6c536: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-a1e5d5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-a1e5d5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-b03a5e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-b03a5e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-e0f003

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-e0f003: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-efbbc5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-efbbc5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-1597f8bc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-1597f8bc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-b132360f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-b132360f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-194506

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-194506: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-65f21d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-65f21d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-7ce670

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-7ce670: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-91a20d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-91a20d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-dff241

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-dff241: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-3eea00

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-3eea00: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-4d9a1a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-4d9a1a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-773fbb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-773fbb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-ad5839

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-ad5839: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-dc3196

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-dc3196: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-6ad168

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-6ad168: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-1a1b45

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-1a1b45: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-30e3dd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-30e3dd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-da4553

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-da4553: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-7d99a4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-7d99a4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-817531

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-817531: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-547a78

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-547a78: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-dd81fd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-dd81fd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-e1a0c2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-e1a0c2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-852107

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-852107: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-26a1d1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-26a1d1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-single-main-a9dee1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-single-main-a9dee1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-a9c9b6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-a9c9b6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-e44313

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-e44313: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-2d5b09

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-2d5b09: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-3c874f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-3c874f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-8d80b1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-8d80b1: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-4tw4m

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-4tw4m to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

Scheduled

Successfully assigned openshift-ingress/e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j to ip-10-0-134-92.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-l4skf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-l4skf to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh to ip-10-0-135-226.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9p5qn to ip-10-0-135-226.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-krlqm

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-krlqm to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq to ip-10-0-134-92.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-pgmcn to ip-10-0-135-226.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-tcgcs to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6 to ip-10-0-134-92.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-vfbtb

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-vfbtb to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cc0859-openshift-default-d7ddc779-slz65 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h to ip-10-0-135-226.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-nnm6r

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-nnm6r to ip-10-0-136-97.ec2.internal

openshift-ingress

kube-auth-proxy-78ccd95bcf-bjqd8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-78ccd95bcf-bjqd8 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt to ip-10-0-135-226.ec2.internal

openshift-ingress

kube-auth-proxy-78ccd95bcf-hzz4f

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-78ccd95bcf-hzz4f to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6 to ip-10-0-135-226.ec2.internal

kuadrant-system

authorino-57f7f8659f-bfg2n

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-bfg2n to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-28ksx to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-2kwq6 to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-55vj6 to ip-10-0-134-92.ec2.internal

kuadrant-system

authorino-66b66c856-5qx55

Scheduled

Successfully assigned kuadrant-system/authorino-66b66c856-5qx55 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss to ip-10-0-134-92.ec2.internal

kuadrant-system

authorino-6889cbd8c4-dhkcx

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-dhkcx to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95 to ip-10-0-135-226.ec2.internal

kuadrant-system

authorino-6f6944bcdd-hvmpm

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-hvmpm to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-6vq44 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-88m6n to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-8cf96 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-9lv85 to ip-10-0-136-97.ec2.internal

kuadrant-system

authorino-7858bd7855-v6qrn

Scheduled

Successfully assigned kuadrant-system/authorino-7858bd7855-v6qrn to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-9p4jh to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-bp56d to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg to ip-10-0-135-226.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-npmx5

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-npmx5 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-fcd5v to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-fl76j to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62 to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-fs5rj to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-gkhfx to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74 to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-h6l2s to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-hcwvj to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72 to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-hpfhc to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5 to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-k6nmr to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7 to ip-10-0-135-226.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-gggrh

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-gggrh to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-lkn75 to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-qb9nw to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-qzl6k to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-r9z2t to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5 to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-s6z4q to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-sq5vm to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-tvsnl to ip-10-0-134-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-vtlvz to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m to ip-10-0-134-92.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-8m78v

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-8m78v to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-wgghh to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w to ip-10-0-135-226.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77bfb58f8c-zkqzg to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5 to ip-10-0-134-92.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-8blbd

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-8blbd to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp to ip-10-0-135-226.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-txkl6

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-txkl6 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b132360f-ff47558fd-jsx99 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z to ip-10-0-136-97.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-x5j7h

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-x5j7h to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l to ip-10-0-135-226.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-ndw77

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-ndw77 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-421ef828-openshift-default-59759b6669-cnhw2 to ip-10-0-135-226.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn to ip-10-0-135-226.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5c85558465-z9pjn

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5c85558465-z9pjn to ip-10-0-136-97.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5c85558465-q84h4

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5c85558465-q84h4 to ip-10-0-135-226.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5c85558465-pdrsd

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5c85558465-pdrsd to ip-10-0-134-92.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-ghfrc to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9 to ip-10-0-135-226.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-rcpz6

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-rcpz6 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk to ip-10-0-134-92.ec2.internal

opendatahub

test-curl-7579-fc70fd

Scheduled

Successfully assigned opendatahub/test-curl-7579-fc70fd to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-acace923-c764674-qvt42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-acace923-c764674-qvt42 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq to ip-10-0-136-97.ec2.internal

ai-tenants

e2e-api-a-585938

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-585938: MaasTenantConfig is not available to restore revocation operands

opendatahub

test-curl-7579-f96b2a

Scheduled

Successfully assigned opendatahub/test-curl-7579-f96b2a to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v to ip-10-0-135-226.ec2.internal

opendatahub

test-curl-7579-ad8907

Scheduled

Successfully assigned opendatahub/test-curl-7579-ad8907 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr to ip-10-0-134-92.ec2.internal

opendatahub

test-curl-7579-a28246

Scheduled

Successfully assigned opendatahub/test-curl-7579-a28246 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh to ip-10-0-135-226.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k to ip-10-0-134-92.ec2.internal

opendatahub

test-curl-7579-18c4cb

Scheduled

Successfully assigned opendatahub/test-curl-7579-18c4cb to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc to ip-10-0-134-92.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p to ip-10-0-135-226.ec2.internal

opendatahub

test-curl-7576-aea268

Scheduled

Successfully assigned opendatahub/test-curl-7576-aea268 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7 to ip-10-0-134-92.ec2.internal

opendatahub

test-curl-7576-4d3b7e

Scheduled

Successfully assigned opendatahub/test-curl-7576-4d3b7e to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw to ip-10-0-135-226.ec2.internal

opendatahub

test-curl-7573-d95056

Scheduled

Successfully assigned opendatahub/test-curl-7573-d95056 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-778cf68b57-lmcwx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-778cf68b57-lmcwx to ip-10-0-135-226.ec2.internal

opendatahub

test-curl-7573-944894

Scheduled

Successfully assigned opendatahub/test-curl-7573-944894 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4 to ip-10-0-135-226.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-vvg6r to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-n9x2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-n9x2v to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6 to ip-10-0-135-226.ec2.internal

opendatahub

test-curl-7573-211a06

Scheduled

Successfully assigned opendatahub/test-curl-7573-211a06 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs to ip-10-0-135-226.ec2.internal

opendatahub

test-curl-7570-9a214b

Scheduled

Successfully assigned opendatahub/test-curl-7570-9a214b to ip-10-0-136-97.ec2.internal

opendatahub

odh-model-controller-769875db56-prfl7

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-prfl7 to ip-10-0-135-226.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-r2cdp

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-r2cdp to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-cf6c69f79-89fc9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-cf6c69f79-89fc9 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968 to ip-10-0-134-92.ec2.internal

opendatahub

maas-controller-7cd5d64f84-4bwrn

Scheduled

Successfully assigned opendatahub/maas-controller-7cd5d64f84-4bwrn to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj to ip-10-0-135-226.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-j59xx

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-j59xx to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-ait-421ef828-8568565666-qmh9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-421ef828-8568565666-qmh9h to ip-10-0-135-226.ec2.internal

opendatahub

maas-controller-679796c8cb-rwz7m

Scheduled

Successfully assigned opendatahub/maas-controller-679796c8cb-rwz7m to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7 to ip-10-0-136-97.ec2.internal

opendatahub

maas-controller-679796c8cb-4z5zf

Scheduled

Successfully assigned opendatahub/maas-controller-679796c8cb-4z5zf to ip-10-0-134-92.ec2.internal

opendatahub

maas-controller-679796c8cb-4dk5t

Scheduled

Successfully assigned opendatahub/maas-controller-679796c8cb-4dk5t to ip-10-0-134-92.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-lp4cp

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-lp4cp to ip-10-0-136-97.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-jk86r

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-jk86r to ip-10-0-136-97.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-bp7bm

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-bp7bm to ip-10-0-136-97.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-9qzhs

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-9qzhs to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7 to ip-10-0-135-226.ec2.internal

llm

e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

Scheduled

Successfully assigned llm/e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h to ip-10-0-135-226.ec2.internal

opendatahub

ai-gateway-controller-b5fdc8966-ztpcp

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-b5fdc8966-ztpcp to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z to ip-10-0-134-92.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-kzdr9

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-kzdr9 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-0393ed-openshift-default-55b9654d67-94749 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-hgcd9

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-hgcd9 to ip-10-0-134-92.ec2.internal

llm

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Scheduled

Successfully assigned llm/e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-58ddc49fd8-p6cp9

Scheduled

Successfully assigned openshift-ingress/payload-processing-58ddc49fd8-p6cp9 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-5797bb5d8c-cnmmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-5797bb5d8c-cnmmz to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv to ip-10-0-134-92.ec2.internal

models-as-a-service

payload-processing-external-model-d5bf6f9f-dmvrs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d5bf6f9f-dmvrs to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr to ip-10-0-135-226.ec2.internal

models-as-a-service

payload-processing-external-model-d5bf6f9f-64gcz

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d5bf6f9f-64gcz to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j to ip-10-0-135-226.ec2.internal

llm

e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

Scheduled

Successfully assigned llm/e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6 to ip-10-0-134-92.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-vhbzz

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-vhbzz to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr to ip-10-0-135-226.ec2.internal

models-as-a-service

payload-processing-external-model-7b6f7fb4f5-z4gp4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7b6f7fb4f5-z4gp4 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6 to ip-10-0-134-92.ec2.internal

models-as-a-service

payload-processing-external-model-758758b45d-v7xhl

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-758758b45d-v7xhl to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn to ip-10-0-135-226.ec2.internal

llm

e2e-same-id-a-d820fa78

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-d820fa78

llm

e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

Scheduled

Successfully assigned llm/e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7 to ip-10-0-134-92.ec2.internal

models-as-a-service

payload-processing-external-model-67d95c9c8-n62m7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-67d95c9c8-n62m7 to ip-10-0-134-92.ec2.internal

openshift-jobset-operator

jobset-controller-manager-d954db9b5-dnclk

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-d954db9b5-dnclk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk to ip-10-0-134-92.ec2.internal

models-as-a-service

payload-processing-external-model-66f6857b97-np5bw

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66f6857b97-np5bw to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m to ip-10-0-135-226.ec2.internal

ai-tenants

e2e-inf-b-b267f8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-b267f8: MaasTenantConfig is not available to restore revocation operands

llm

e2e-same-id-b-d820fa78

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-d820fa78

llm

e2e-same-id-b-d820fa78

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-k7xc4 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj to ip-10-0-136-97.ec2.internal

models-as-a-service

payload-processing-external-model-5bc757568-tjkvv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bc757568-tjkvv to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25 to ip-10-0-134-92.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx to ip-10-0-136-97.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-bcrdv

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-bcrdv to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5 to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26 to ip-10-0-135-226.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5 to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8 to ip-10-0-134-92.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

Scheduled

Successfully assigned openshift-ingress/e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks to ip-10-0-134-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf to ip-10-0-134-92.ec2.internal

openshift-ingress

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4 to ip-10-0-135-226.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2 to ip-10-0-135-226.ec2.internal

openshift-ingress

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk to ip-10-0-135-226.ec2.internal

models-as-a-service

payload-processing-external-model-54bdbcb9db-kxlgg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-54bdbcb9db-kxlgg to ip-10-0-134-92.ec2.internal

openshift-ingress

router-default-59ddf86b9f-2wfp9

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-59ddf86b9f-2wfp9

FailedScheduling

no nodes available to schedule pods

models-as-a-service

payload-processing-external-model-5bc757568-bkxtv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bc757568-bkxtv to ip-10-0-136-97.ec2.internal

openshift-ingress

router-default-59ddf86b9f-2wfp9

Scheduled

Successfully assigned openshift-ingress/router-default-59ddf86b9f-2wfp9 to ip-10-0-135-226.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-59ddf86b9f from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-59ddf86b9f

SuccessfulCreate

Created pod: router-default-59ddf86b9f-2wfp9
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-59ddf86b9f-2wfp9

AddedInterface

Add eth0 [10.133.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

Created

Container created

openshift-ingress

kubelet

router-default-59ddf86b9f-2wfp9

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-l4skf

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-l4skf

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.475s (3.475s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-fl76j

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6bd8768855

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6bd8768855 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd8768855-g87vm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.624s (7.624s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.209s (8.209s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-5c85558465 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5c85558465

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5c85558465-q84h4

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5c85558465

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5c85558465-pdrsd

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5c85558465

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5c85558465-z9pjn

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5c85558465-pdrsd

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5c85558465-q84h4

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5c85558465-z9pjn

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.835s (2.835s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.815s (2.815s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.881s (2.881s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-z9pjn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 298ms (298ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 302ms (302ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-q84h4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Created

Container created
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 274ms (274ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5c85558465-pdrsd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-5c85558465-z9pjn_ae44305a-f192-45ce-bd14-52ceb265d6e6

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-5c85558465-z9pjn_ae44305a-f192-45ce-bd14-52ceb265d6e6 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-qj2zd

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-vhbzz
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-vhbzz

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vhbzz

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vhbzz

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-vhbzz_6f35dcfa-7dce-4a44-94c5-bdcf6f10d54d became leader
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vhbzz

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vhbzz

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.846s (2.846s including waiting). Image size: 224874686 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-gggrh

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-gggrh

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gggrh

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gggrh

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-rcpz6

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gggrh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.754s (2.754s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gggrh

Created

Container created

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

dns-operator-controller-manager-8557cbdb84-gggrh_e994c944-3a80-4299-8add-0b1b73edd5f8

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-gggrh_e994c944-3a80-4299-8add-0b1b73edd5f8 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rcpz6

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-rcpz6

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rcpz6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.401s (1.401s including waiting). Image size: 177967631 bytes.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rcpz6

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-rcpz6_404c389e-df34-49fb-a90d-d15c475da92d

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-rcpz6_404c389e-df34-49fb-a90d-d15c475da92d became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-rcpz6

Created

Container created

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-vfbtb

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-vfbtb

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vfbtb

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-txkl6

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-krlqm

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-txkl6

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-txkl6

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-krlqm

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-krlqm

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vfbtb

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vfbtb

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.456s (3.456s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-vfbtb

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-krlqm

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-krlqm

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 1.837s (1.837s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-krlqm

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-txkl6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.585s (3.585s including waiting). Image size: 424244516 bytes.

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-txkl6

Created

Container created

kuadrant-system

multus

authorino-operator-7b7bb4bc77-npmx5

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-txkl6_a7bfdee4-1ae1-439c-b9bd-98ccc887e230

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-txkl6_a7bfdee4-1ae1-439c-b9bd-98ccc887e230 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-npmx5

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-txkl6

Started

Container started

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-npmx5

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-npmx5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.232s (1.232s including waiting). Image size: 167738465 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68dd7b898f from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-78ccd95bcf

SuccessfulCreate

Created pod: kube-auth-proxy-78ccd95bcf-bjqd8

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-78ccd95bcf from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-78ccd95bcf

SuccessfulCreate

Created pod: kube-auth-proxy-78ccd95bcf-hzz4f

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68dd7b898f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-hzz4f

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-npmx5

Created

Container created

openshift-ingress

multus

kube-auth-proxy-78ccd95bcf-hzz4f

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-npmx5

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

kuadrant-system

authorino-operator-7b7bb4bc77-npmx5_60e8ee43-2f90-428e-a04e-eed8460b6f69

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-npmx5_60e8ee43-2f90-428e-a04e-eed8460b6f69 became leader

openshift-ingress

multus

kube-auth-proxy-78ccd95bcf-bjqd8

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-bjqd8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68dd7b898fjtrrn

Created

Container created

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-x5j7h

kuadrant-system

multus

limitador-limitador-74dfcfb894-x5j7h

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-x5j7h

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-nnm6r

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

multus

authorino-57f7f8659f-bfg2n

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-hzz4f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.484s (2.484s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-bfg2n

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-bjqd8

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-hzz4f

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-bjqd8

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-bjqd8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.308s (2.308s including waiting). Image size: 188904677 bytes.

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-8m78v

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-ndw77

openshift-ingress

kubelet

kube-auth-proxy-78ccd95bcf-hzz4f

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-bfg2n

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

authorino-56c6c9ddd5-nnm6r

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8m78v

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-8m78v

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-ndw77

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-4tw4m

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-bp7bm

kuadrant-system

multus

authorino-56c6c9ddd5-nnm6r

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-ndw77

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-x5j7h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.989s (2.989s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-x5j7h

Created

Container created

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-bp7bm

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-bp7bm

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-x5j7h

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-4tw4m

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-597b95cb84-4tw4m

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-bfg2n

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.483s (2.483s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-ndw77

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-bfg2n

kuadrant-system

kubelet

authorino-56c6c9ddd5-nnm6r

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.889s (1.889s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-ndw77

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.915s (1.915s including waiting). Image size: 133379307 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-bfg2n

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nnm6r

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nnm6r

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-bfg2n

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-ndw77

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-bp7bm

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-bp7bm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.523s (1.523s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-bp7bm

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-4tw4m

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-4tw4m

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-4tw4m

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.804s (2.804s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-bfg2n

Killing

Stopping container authorino

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8m78v

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8m78v

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-8m78v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.032s (5.032s including waiting). Image size: 342538866 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-x5j7h

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-x5j7h

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

kserve-module-controller-manager-7566cf5fc8-bp7bm_de37b438-fe26-43e1-8204-8ba1b0ff8969

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-bp7bm_de37b438-fe26-43e1-8204-8ba1b0ff8969 became leader

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7cd5d64f84 from 0 to 1

opendatahub

replicaset-controller

maas-controller-7cd5d64f84

SuccessfulCreate

Created pod: maas-controller-7cd5d64f84-4bwrn

opendatahub

replicaset-controller

maas-controller-679796c8cb

SuccessfulCreate

Created pod: maas-controller-679796c8cb-4dk5t

opendatahub

multus

maas-controller-7cd5d64f84-4bwrn

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7cd5d64f84-4bwrn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2"

opendatahub

multus

maas-controller-679796c8cb-4dk5t

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7cd5d64f84-4bwrn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2" in 2.684s (2.684s including waiting). Image size: 200057368 bytes.

opendatahub

kubelet

maas-controller-7cd5d64f84-4bwrn

Created

Container created

opendatahub

kubelet

maas-controller-7cd5d64f84-4bwrn

Started

Container started

opendatahub

kubelet

maas-controller-679796c8cb-4dk5t

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2" in 2.528s (2.528s including waiting). Image size: 200057368 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-7cd5d64f84-4bwrn_ac018d6c-8906-46a6-9074-f06e8bcd8dad

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7cd5d64f84-4bwrn_ac018d6c-8906-46a6-9074-f06e8bcd8dad became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7cd5d64f84 from 1 to 0

opendatahub

kubelet

maas-controller-7cd5d64f84-4bwrn

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-7cd5d64f84

SuccessfulDelete

Deleted pod: maas-controller-7cd5d64f84-4bwrn

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-tcgcs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-prfl7

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-lp4cp

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-lp4cp

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-r2cdp

opendatahub

kubelet

kserve-controller-manager-776cc66d47-9qzhs

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

odh-model-controller-769875db56-prfl7

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-prfl7

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

kserve-controller-manager-776cc66d47-9qzhs

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.076s (13.076s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lp4cp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-9qzhs

opendatahub

multus

model-serving-api-75bd89fdfc-r2cdp

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-tcgcs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

model-serving-api-75bd89fdfc-r2cdp

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ghfrc

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4skf

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-l4skf

opendatahub

kubelet

model-serving-api-75bd89fdfc-r2cdp

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-r2cdp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.904s (1.904s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-r2cdp

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-prfl7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.486s (2.486s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lp4cp

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lp4cp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.373s (2.373s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lp4cp

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-9qzhs

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.575s (2.575s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-9qzhs

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-9qzhs

Started

Container started

opendatahub

odh-model-controller-769875db56-prfl7_b7d08950-6c20-4a6a-887b-9f6f88d3736b

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-prfl7_b7d08950-6c20-4a6a-887b-9f6f88d3736b became leader

opendatahub

kubelet

odh-model-controller-769875db56-prfl7

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-9qzhs_559b11e3-9665-4f9d-84f6-acb02d886199

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-9qzhs_559b11e3-9665-4f9d-84f6-acb02d886199 became leader

opendatahub

kubelet

odh-model-controller-769875db56-prfl7

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-lp4cp_d50b8caa-2d4e-4239-b0cb-549b0d7401cc

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-lp4cp_d50b8caa-2d4e-4239-b0cb-549b0d7401cc became leader

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-2mgl9"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-dslph"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-d954db9b5-dnclk

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-d954db9b5-dnclk

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-d954db9b5

SuccessfulCreate

Created pod: jobset-controller-manager-d954db9b5-dnclk

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-d954db9b5 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

opendatahub

maas-controller-679796c8cb-4dk5t_30e65d68-6929-4b22-a5ed-d47b03c8a2ba

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-679796c8cb-4dk5t_30e65d68-6929-4b22-a5ed-d47b03c8a2ba became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-d954db9b5-dnclk

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.687s (2.687s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-d954db9b5-dnclk

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-d954db9b5-dnclk

Started

Container started

openshift-jobset-operator

jobset-controller-manager-d954db9b5-dnclk_afbec74c-902b-4eba-9939-4d61d87f97e2

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-d954db9b5-dnclk_afbec74c-902b-4eba-9939-4d61d87f97e2 became leader

kuadrant-system

multus

authorino-6f6944bcdd-hvmpm

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7858bd7855 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-dhkcx

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-hvmpm

kuadrant-system

replicaset-controller

authorino-7858bd7855

SuccessfulCreate

Created pod: authorino-7858bd7855-v6qrn

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-dhkcx

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-hvmpm

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

kubelet

authorino-6f6944bcdd-hvmpm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

kubelet

authorino-7858bd7855-v6qrn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 313ms (313ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-7858bd7855-v6qrn

Created

Container created

kuadrant-system

multus

authorino-7858bd7855-v6qrn

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-7858bd7855-v6qrn

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6f6944bcdd-hvmpm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 505ms (505ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-nnm6r

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6f6944bcdd-hvmpm

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-nnm6r

kuadrant-system

kubelet

authorino-6f6944bcdd-hvmpm

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-hvmpm

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-7858bd7855-v6qrn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

llmisvc-controller-manager-6466c554d8-jk86r

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-jk86r

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jk86r

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jk86r

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jk86r

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-jk86r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 373ms (373ms including waiting). Image size: 235100981 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-lp4cp

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-lp4cp

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-kzdr9

opendatahub

multus

ai-gateway-controller-7d85675f98-kzdr9

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-kzdr9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-kzdr9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.483s (1.483s including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-kzdr9

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-kzdr9

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-kzdr9_f245190f-90c3-464f-824b-dccc809ab52a

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-kzdr9_f245190f-90c3-464f-824b-dccc809ab52a became leader

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-hgcd9
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-n9x2v

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n9x2v

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-hgcd9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-n9x2v

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5f78687d5b-hgcd9

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n9x2v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.364s (2.364s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-hgcd9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n9x2v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n9x2v

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-hgcd9

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-hgcd9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.315s (2.315s including waiting). Image size: 125317101 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-b5fdc8966 from 0 to 1

opendatahub

multus

ai-gateway-controller-b5fdc8966-ztpcp

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-b5fdc8966

SuccessfulCreate

Created pod: ai-gateway-controller-b5fdc8966-ztpcp

opendatahub

kubelet

ai-gateway-controller-b5fdc8966-ztpcp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-b5fdc8966-ztpcp

Created

Container created

opendatahub

kubelet

ai-gateway-controller-b5fdc8966-ztpcp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 742ms (742ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-b5fdc8966-ztpcp

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-jk86r_31bd09e3-d801-43dd-b305-38e27e505866

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-jk86r_31bd09e3-d801-43dd-b305-38e27e505866 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-kzdr9

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-kzdr9
(x2)

opendatahub

kubelet

maas-controller-679796c8cb-4dk5t

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2"
(x2)

opendatahub

kubelet

maas-controller-679796c8cb-4dk5t

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-679796c8cb-4dk5t

Started

Container started

opendatahub

kubelet

maas-controller-679796c8cb-4dk5t

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2" in 372ms (373ms including waiting). Image size: 200057368 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.197s (1.197s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-4wc6k

Created

Container created

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.314s (1.314s including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-j59xx

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-vvg6r

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-j59xx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 178ms (178ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-j59xx

Started

Container started

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-j59xx

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-j59xx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-j59xx

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 204ms (204ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-k7xc4

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 175ms (175ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8tn8c5

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bcrdv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-bcrdv

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-bcrdv

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bcrdv

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bcrdv

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bcrdv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.462s (1.462s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

opendatahub

maas-controller-679796c8cb-4dk5t_7ba24d58-f2ec-4af8-9b07-6a955006730a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-679796c8cb-4dk5t_7ba24d58-f2ec-4af8-9b07-6a955006730a became leader

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

opendatahub

ai-gateway-controller-b5fdc8966-ztpcp_84326777-018a-4c6c-a414-a06e290f9010

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-b5fdc8966-ztpcp_84326777-018a-4c6c-a414-a06e290f9010 became leader

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 189ms (189ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h5wsn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 221ms (221ms including waiting). Image size: 98346788 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

Started

Container started

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-n2v2v

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-8cf96

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.875s (2.875s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.833s (2.833s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Created

Container created

kuadrant-system

replicaset-controller

authorino-66b66c856

SuccessfulCreate

Created pod: authorino-66b66c856-5qx55

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

kuadrant-system

multus

authorino-66b66c856-5qx55

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-66b66c856-5qx55

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-66b66c856-5qx55

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 630ms (630ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-7858bd7855 from 1 to 0

kuadrant-system

kubelet

authorino-7858bd7855-v6qrn

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-7858bd7855

SuccessfulDelete

Deleted pod: authorino-7858bd7855-v6qrn

kuadrant-system

kubelet

authorino-66b66c856-5qx55

Started

Container started

kuadrant-system

kubelet

authorino-66b66c856-5qx55

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-migrate-acace923-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-acace923-gw-openshift-default-77b6d8d9df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a788fe69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a788fe69

openshift-ingress

replicaset-controller

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f

SuccessfulCreate

Created pod: e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

openshift-ingress

deployment-controller

e2e-ait-c7c56c3d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c7c56c3d-openshift-default-7b54b69b4f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-acace923-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-acace923-gw

openshift-ingress

replicaset-controller

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df

SuccessfulCreate

Created pod: e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

openshift-ingress

gateway_labeler_controller

e2e-ait-c7c56c3d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c7c56c3d

openshift-ingress

deployment-controller

e2e-ait-a788fe69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a788fe69-openshift-default-86bb65fb5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a788fe69-openshift-default-86bb65fb5c

SuccessfulCreate

Created pod: e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

openshift-ingress

multus

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-421ef828

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-421ef828

openshift-ingress

multus

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-421ef828-openshift-default-59759b6669

SuccessfulCreate

Created pod: e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

openshift-ingress

deployment-controller

e2e-ait-421ef828-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-421ef828-openshift-default-59759b6669 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-acace923-85d999b499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-acace923

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-acace923-c764674 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-acace923-c764674

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-acace923-c764674-qvt42
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-acace923-c764674

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-acace923-c764674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-acace923: serviceaccount "payload-processing-e2e-migrate-acace923" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-acace923

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-acace923-85d999b499 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-acace923-85d999b499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-acace923-85d999b499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-acace923: serviceaccount "payload-processing-e2e-migrate-acace923" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-migrate-acace923-c764674-qvt42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-acace923-c764674-qvt42

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-acace923-c764674-qvt42

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-acace923-c764674-qvt42

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a788fe69-79c4985579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a788fe69-79c4985579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a788fe69: serviceaccount "payload-processing-e2e-ait-a788fe69" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a788fe69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a788fe69-7dc774fc78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a788fe69-79c4985579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a788fe69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a788fe69-79c4985579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a788fe69-7dc774fc78

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a788fe69-7dc774fc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a788fe69: serviceaccount "payload-processing-e2e-ait-a788fe69" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a788fe69-7dc774fc78

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

openshift-ingress

kubelet

payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.292s (2.292s including waiting). Image size: 125317101 bytes.

openshift-ingress

multus

payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c7c56c3d: serviceaccount "payload-processing-e2e-ait-c7c56c3d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c7c56c3d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c7c56c3d-8956cc6f4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c7c56c3d-8956cc6f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c7c56c3d: serviceaccount "payload-processing-e2e-ait-c7c56c3d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c7c56c3d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c7c56c3d-8956cc6f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-3f9206f0-openshift-default-78798cc465

SuccessfulCreate

Created pod: e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

openshift-ingress

gateway_labeler_controller

e2e-derive-3f9206f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3f9206f0

openshift-ingress

deployment-controller

e2e-derive-3f9206f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3f9206f0-openshift-default-78798cc465 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c7c56c3d-8956cc6f4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

openshift-ingress

kubelet

payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-421ef828

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-421ef828-7bd56c55f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-421ef828-7bd56c55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

openshift-ingress

kubelet

payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-421ef828-7bd56c55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-421ef828-7bd56c55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-421ef828: serviceaccount "payload-processing-e2e-ait-421ef828" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-421ef828

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-421ef828-8568565666 from 0 to 1

openshift-ingress

multus

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-421ef828-8568565666

SuccessfulCreate

Created pod: payload-processing-e2e-ait-421ef828-8568565666-qmh9h
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-421ef828-8568565666

FailedCreate

Error creating: pods "payload-processing-e2e-ait-421ef828-8568565666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-421ef828: serviceaccount "payload-processing-e2e-ait-421ef828" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-421ef828-8568565666-qmh9h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-421ef828-8568565666-qmh9h

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-421ef828-8568565666-qmh9h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-421ef828-8568565666-qmh9h

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3f9206f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3f9206f0-76cf568f68 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3f9206f0-76cf568f68

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3f9206f0-76cf568f68-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3f9206f0: serviceaccount "payload-processing-e2e-derive-3f9206f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3f9206f0-76cf568f68

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3f9206f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3f9206f0: serviceaccount "payload-processing-e2e-derive-3f9206f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8

Started

Container started

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:48012->10.133.0.57:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:48012->10.133.0.57:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-3f9206f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-3f9206f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a788fe69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a788fe69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c7c56c3d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-acace923-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-acace923-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c7c56c3d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-421ef828-8568565666-qmh9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-421ef828-7bd56c55f-jc968

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-421ef828-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-421ef828-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-3f9206f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-3f9206f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-a788fe69-7dc774fc78-sj6zj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-acace923-85d999b499-wpb26

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-acace923-c764674-qvt42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a788fe69-79c4985579-qbqv2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c7c56c3d-8956cc6f4-twwb9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c7c56c3d-6b99fb575-96bgk

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-421ef828-openshift-default-59759b6669-cnhw2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a9c9b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a9c9b6

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 0 to 1

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c7c56c3d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-migrate-acace923-gw-openshift-default-77b6d8d9df-ljsnz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c7c56c3d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-a788fe69-openshift-default-86bb65fb5c-5t46w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-3c874f-openshift-default-75f5654dfc

SuccessfulCreate

Created pod: e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-3c874f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-3c874f

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-2d5b09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-2d5b09

openshift-ingress

deployment-controller

e2e-worker-w3-3c874f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3c874f-openshift-default-75f5654dfc from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49

SuccessfulCreate

Created pod: e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

openshift-ingress

deployment-controller

e2e-worker-w2-2d5b09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-3f9206f0-76cf568f68-pnmwl

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-8d80b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-8d80b1

openshift-ingress

multus

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f9206f0-6f45b6df9f-lllv8

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulCreate

Created pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

openshift-ingress

kubelet

e2e-derive-3f9206f0-openshift-default-78798cc465-nvfqc

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a9c9b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a9c9b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a9c9b6-5c46996b86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a9c9b6: serviceaccount "payload-processing-e2e-worker-w0-a9c9b6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a9c9b6: serviceaccount "payload-processing-e2e-worker-w0-a9c9b6" not found

openshift-ingress

kubelet

e2e-ait-c7c56c3d-openshift-default-7b54b69b4f-s5lr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e44313-openshift-default-d5f88445f

SuccessfulCreate

Created pod: e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-e44313

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-e44313

openshift-ingress

deployment-controller

e2e-worker-w1-e44313-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e44313-openshift-default-d5f88445f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

Created

Container created

openshift-ingress

multus

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-2d5b09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-2d5b09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-2d5b09: serviceaccount "payload-processing-e2e-worker-w2-2d5b09" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-2d5b09: serviceaccount "payload-processing-e2e-worker-w2-2d5b09" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-8d80b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8d80b1: serviceaccount "payload-processing-e2e-worker-w4-8d80b1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-8d80b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8d80b1: serviceaccount "payload-processing-e2e-worker-w4-8d80b1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-3c874f-998846cc4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-3c874f-998846cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-3c874f: serviceaccount "payload-processing-e2e-worker-w3-3c874f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-3c874f-998846cc4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-3c874f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-3c874f-998846cc4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-3c874f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-3c874f: serviceaccount "payload-processing-e2e-worker-w3-3c874f" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-e44313

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-e44313-596b94c9b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-e44313-596b94c9b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-e44313-596b94c9b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-e44313-596b94c9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e44313: serviceaccount "payload-processing-e2e-worker-w1-e44313" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e44313: serviceaccount "payload-processing-e2e-worker-w1-e44313" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-e44313

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3c874f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3c874f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e44313-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e44313-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3c874f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3c874f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

Started

Container started

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-e44313-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e44313-openshift-default-d5f88445f from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-e44313-openshift-default-d5f88445f

SuccessfulCreate

Created pod: e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e44313-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49

SuccessfulCreate

Created pod: e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-2d5b09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulCreate

Created pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

Created

Container created

openshift-ingress

multus

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49

SuccessfulCreate

Created pod: e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-2d5b09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e44313-openshift-default-d5f88445f

SuccessfulCreate

Created pod: e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

openshift-ingress

deployment-controller

e2e-worker-w1-e44313-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e44313-openshift-default-d5f88445f from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e44313-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulCreate

Created pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

openshift-ingress

multus

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qb9nw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-8cf96

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-8cf96

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hpfhc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 3 to 2

openshift-ingress

replicaset-controller

e2e-mt-b132360f-openshift-default-75cb596d5c

SuccessfulCreate

Created pod: e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

openshift-ingress

deployment-controller

e2e-mt-b132360f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b132360f-openshift-default-75cb596d5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-b132360f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b132360f

openshift-ingress

multus

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b132360f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b132360f-ff47558fd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b132360f-ff47558fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b132360f: serviceaccount "payload-processing-e2e-mt-b132360f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b132360f-ff47558fd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b132360f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b132360f-ff47558fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b132360f: serviceaccount "payload-processing-e2e-mt-b132360f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 2 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-f247d1-openshift-default-6b77d647bf

SuccessfulCreate

Created pod: e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

openshift-ingress

deployment-controller

e2e-api-a-f247d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f247d1-openshift-default-6b77d647bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-f247d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f247d1

openshift-ingress

multus

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f247d1-5f878678f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f247d1-5f878678f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f247d1: serviceaccount "payload-processing-e2e-api-a-f247d1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f247d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f247d1-79c5fb4d46 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f247d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f247d1-5f878678f5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f247d1-79c5fb4d46

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f247d1-79c5fb4d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f247d1: serviceaccount "payload-processing-e2e-api-a-f247d1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f247d1-79c5fb4d46

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f247d1-5f878678f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

openshift-ingress

kubelet

payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-585938-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-585938-openshift-default-7d8b79888f from 0 to 1

openshift-ingress

multus

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

openshift-ingress

gateway_labeler_controller

e2e-api-a-585938

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-585938

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-585938-openshift-default-7d8b79888f

SuccessfulCreate

Created pod: e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 3 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-585938-d67fbcff4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-585938-d67fbcff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-585938: serviceaccount "payload-processing-e2e-api-a-585938" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-585938

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-585938-5495967d7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-585938-5495967d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-585938-5495967d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-585938: serviceaccount "payload-processing-e2e-api-a-585938" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-585938

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-585938-d67fbcff4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-585938-d67fbcff4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-585938-5495967d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

openshift-ingress

multus

payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-585938-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-585938-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b132360f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b132360f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-3e4daf-openshift-default-7d5fddbfc

SuccessfulCreate

Created pod: e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

openshift-ingress

deployment-controller

e2e-api-b-3e4daf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3e4daf-openshift-default-7d5fddbfc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-3e4daf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3e4daf

openshift-ingress

multus

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3e4daf-5ccf85944b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3e4daf-5ccf85944b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3e4daf: serviceaccount "payload-processing-e2e-api-b-3e4daf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3e4daf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3e4daf-5ccf85944b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3e4daf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3e4daf: serviceaccount "payload-processing-e2e-api-b-3e4daf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3e4daf-5ccf85944b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz
(x5)

openshift-ingress

kubelet

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-cc0859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cc0859-openshift-default-d7ddc779 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-cc0859

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cc0859

openshift-ingress

replicaset-controller

e2e-api-b-cc0859-openshift-default-d7ddc779

SuccessfulCreate

Created pod: e2e-api-b-cc0859-openshift-default-d7ddc779-slz65
(x2)

openshift-ingress

kubelet

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

Created

Container created

openshift-ingress

multus

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cc0859-58898cb84c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cc0859-58898cb84c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cc0859: serviceaccount "payload-processing-e2e-api-b-cc0859" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cc0859-58898cb84c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cc0859

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cc0859-58898cb84c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cc0859-74dbb467c6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr
(x5)

openshift-ingress

kubelet

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cc0859

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cc0859-74dbb467c6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cc0859-74dbb467c6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cc0859-74dbb467c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cc0859: serviceaccount "payload-processing-e2e-api-b-cc0859" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-a-3b93b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3b93b5

openshift-ingress

replicaset-controller

e2e-api-a-3b93b5-openshift-default-d878cd889

SuccessfulCreate

Created pod: e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

openshift-ingress

deployment-controller

e2e-api-a-3b93b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-3b93b5-openshift-default-d878cd889 from 0 to 1

openshift-ingress

multus

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7576-4d3b7e

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7576-4d3b7e

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7576-4d3b7e

Created

Container created

opendatahub

kubelet

test-curl-7576-4d3b7e

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.872s (1.872s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7576-4d3b7e

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-3b93b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-3b93b5-66b74d8555 from 0 to 1

opendatahub

kubelet

test-curl-7576-4d3b7e

Killing

Stopping container test-curl-7576-4d3b7e

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-3b93b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-3b93b5-f4d8d5c5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3b93b5: serviceaccount "payload-processing-e2e-api-a-3b93b5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3b93b5: serviceaccount "payload-processing-e2e-api-a-3b93b5" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

openshift-ingress

kubelet

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f247d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f247d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-585938-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-585938-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-vxxxg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-jsx99

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f247d1-5f878678f5-4kscf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f247d1-79c5fb4d46-lwjlq

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-99shv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-zb6rx

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 5 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc0859-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-b-cc0859-openshift-default-d7ddc779

SuccessfulCreate

Created pod: e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

openshift-ingress

deployment-controller

e2e-api-b-cc0859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cc0859-openshift-default-d7ddc779 from 1 to 2
(x2)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Created

Container created

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Created

Container created

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3e4daf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3e4daf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-a-585938-d67fbcff4-d7fhs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-585938-5495967d7f-wkxdx

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-f247d1-openshift-default-6b77d647bf-p24vk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-n7lql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b132360f: serviceaccount "payload-processing-e2e-mt-b132360f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b132360f-ff47558fd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b132360f-ff47558fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b132360f: serviceaccount "payload-processing-e2e-mt-b132360f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

openshift-ingress

deployment-controller

e2e-worker-w2-2d5b09-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49 from 3 to 2

openshift-ingress

gateway_labeler_controller

e2e-api-b-d4b0d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d4b0d5

openshift-ingress

replicaset-controller

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49

SuccessfulDelete

Deleted pod: e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-j7m5p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b132360f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc0859-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b132360f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b132360f-ff47558fd from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc0859-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-b-d4b0d5-openshift-default-7dcf44b869

SuccessfulCreate

Created pod: e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-585938-openshift-default-7d8b79888f-t8kxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-d4b0d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d4b0d5-openshift-default-7dcf44b869 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b132360f-ff47558fd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-3e4daf-5ccf85944b-d26rz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3e4daf-6cbfb4d5d7-xz92p

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3e4daf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3e4daf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d4b0d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d4b0d5-7978d5d8c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d4b0d5: serviceaccount "payload-processing-e2e-api-b-d4b0d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d4b0d5: serviceaccount "payload-processing-e2e-api-b-d4b0d5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d4b0d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc0859-58898cb84c-dk9q5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc0859-74dbb467c6-qvffr

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-3e4daf-openshift-default-7d5fddbfc-sc46w

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc0859-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc0859-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Started

Container started
(x4)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-2bkgx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-cc0859-openshift-default-d7ddc779-slz65

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3b93b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3b93b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:

opendatahub

multus

test-curl-7576-aea268

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7576-aea268

Started

Container started

opendatahub

kubelet

test-curl-7576-aea268

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7576-aea268

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-e44313-openshift-default-d5f88445f

SuccessfulDelete

Deleted pod: e2e-worker-w1-e44313-openshift-default-d5f88445f-qjxzt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e44313-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-e44313-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e44313-openshift-default-d5f88445f from 3 to 2

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d6c536

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d6c536

openshift-ingress

deployment-controller

e2e-ipp-a-d6c536-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5

SuccessfulCreate

Created pod: e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

openshift-ingress

multus

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7576-aea268

Killing

Stopping container test-curl-7576-aea268
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3b93b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3b93b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d6c536

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d6c536

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d6c536: serviceaccount "payload-processing-e2e-ipp-a-d6c536" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d6c536: serviceaccount "payload-processing-e2e-ipp-a-d6c536" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3b93b5-66b74d8555-zvmrz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-3b93b5-f4d8d5c5d-hn5w9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c

SuccessfulCreate

Created pod: e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

openshift-ingress

deployment-controller

e2e-ipp-a-04fdf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-04fdf3-openshift-default-c7b5c969c from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d4b0d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d4b0d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-04fdf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-04fdf3

openshift-ingress

multus

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-04fdf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04fdf3: serviceaccount "payload-processing-e2e-ipp-a-04fdf3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-04fdf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04fdf3: serviceaccount "payload-processing-e2e-ipp-a-04fdf3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-3b93b5-openshift-default-d878cd889-gtt8d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d4b0d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d4b0d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d4b0d5-76dcbfb975-d84xf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d4b0d5-7978d5d8c8-6gc5c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-574b6688d7-l45ss

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d6c536-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d6c536-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-mt-b132360f-ff47558fd-5rxjp

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.117:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b132360f-55d7d7d6b7-qwmj8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.116:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-58d9b4c9cd-swp85

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.123:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-b132360f-openshift-default-75cb596d5c-s5rds

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d6c536-584f8cd944

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d6c536-584f8cd944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d6c536: serviceaccount "payload-processing-e2e-ipp-a-d6c536" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d6c536

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d6c536: serviceaccount "payload-processing-e2e-ipp-a-d6c536" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d6c536

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d6c536-584f8cd944 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d6c536-584f8cd944

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-04fdf3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-04fdf3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.592s (1.592s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

Started

Container started

openshift-ingress

kubelet

e2e-api-b-d4b0d5-openshift-default-7dcf44b869-xnwhj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.484s (1.484s including waiting). Image size: 166612641 bytes.

openshift-ingress

deployment-controller

e2e-ipp-a-499bca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-499bca-openshift-default-769dd4644c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-499bca-openshift-default-769dd4644c

SuccessfulCreate

Created pod: e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-499bca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-499bca

openshift-ingress

multus

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-499bca: serviceaccount "payload-processing-e2e-ipp-a-499bca" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-499bca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-499bca-5498f77768 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-499bca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-499bca-5498f77768

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-499bca-5498f77768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-499bca: serviceaccount "payload-processing-e2e-ipp-a-499bca" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-499bca-5498f77768

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-589b6d6f9f-8lmdp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-7f9f845fd6-zpr7m

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a1e5d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a1e5d5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-ipp-b-a1e5d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475

SuccessfulCreate

Created pod: e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

ProbeError

Readiness probe error: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Unhealthy

Readiness probe failed: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

ProbeError

Readiness probe error: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Unhealthy

Readiness probe failed: Get "http://10.133.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d6c536-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d6c536-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1e5d5: serviceaccount "payload-processing-e2e-ipp-b-a1e5d5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a1e5d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1e5d5: serviceaccount "payload-processing-e2e-ipp-b-a1e5d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a1e5d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-04fdf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-04fdf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-04fdf3-654b554d84 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04fdf3-654b554d84

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04fdf3-654b554d84

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-04fdf3-654b554d84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04fdf3: serviceaccount "payload-processing-e2e-ipp-a-04fdf3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04fdf3: serviceaccount "payload-processing-e2e-ipp-a-04fdf3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6c106c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6c106c

openshift-ingress

deployment-controller

e2e-ipp-a-6c106c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6c106c-openshift-default-667dbc4649 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-6c106c-openshift-default-667dbc4649

SuccessfulCreate

Created pod: e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

openshift-ingress

multus

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c106c-649b997699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6c106c-649b997699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c106c: serviceaccount "payload-processing-e2e-ipp-a-6c106c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6c106c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6c106c-649b997699 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6c106c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6c106c-6ccfc8f874 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c106c: serviceaccount "payload-processing-e2e-ipp-a-6c106c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c106c-649b997699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e0f003

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e0f003

openshift-ingress

replicaset-controller

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c

SuccessfulCreate

Created pod: e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

openshift-ingress

deployment-controller

e2e-ipp-b-e0f003-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e0f003-openshift-default-7f5975bd9c from 0 to 1

openshift-ingress

multus

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e0f003: serviceaccount "payload-processing-e2e-ipp-b-e0f003" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e0f003

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e0f003

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e0f003-5f8c76fffd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e0f003: serviceaccount "payload-processing-e2e-ipp-b-e0f003" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

openshift-ingress

multus

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.057s (2.057s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-5498f77768-4fhh5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-7fd5ccbdd7-qzjmj

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e0f003-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e0f003-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-04fdf3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-04fdf3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a1e5d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a1e5d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-499bca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-499bca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-79d784d8bc-9tb2f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-78ddfb557b-mb5sm

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-499bca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-499bca: serviceaccount "payload-processing-e2e-ipp-a-499bca" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-499bca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-499bca-67c4f5d754 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-499bca-67c4f5d754

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-499bca-67c4f5d754

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-499bca-67c4f5d754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-499bca: serviceaccount "payload-processing-e2e-ipp-a-499bca" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c106c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c106c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-6ccfc8f874-mrkvs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-649b997699-gp2n7

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-499bca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-499bca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a1e5d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a1e5d5-798584d5c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1e5d5: serviceaccount "payload-processing-e2e-ipp-b-a1e5d5" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a1e5d5: serviceaccount "payload-processing-e2e-ipp-b-a1e5d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a1e5d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b03a5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b03a5e

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-b-b03a5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f

SuccessfulCreate

Created pod: e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

openshift-ingress

multus

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b03a5e-5786848cf8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b03a5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

openshift-ingress

multus

payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b03a5e: serviceaccount "payload-processing-e2e-ipp-b-b03a5e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b03a5e-5786848cf8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b03a5e-5786848cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b03a5e: serviceaccount "payload-processing-e2e-ipp-b-b03a5e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b03a5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b03a5e-5786848cf8 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a1e5d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a1e5d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-5f8c76fffd-sfzlt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-6544db76cf-47lbn

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c106c-695c8457d4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6c106c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6c106c-695c8457d4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c106c: serviceaccount "payload-processing-e2e-ipp-a-6c106c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6c106c-695c8457d4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6c106c-695c8457d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6c106c: serviceaccount "payload-processing-e2e-ipp-a-6c106c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6c106c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c106c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c106c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-dff241

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-dff241

openshift-ingress

replicaset-controller

e2e-praxis-a-dff241-openshift-default-789f678dc7

SuccessfulCreate

Created pod: e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

openshift-ingress

deployment-controller

e2e-praxis-a-dff241-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-dff241-openshift-default-789f678dc7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dff241-747567f57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-dff241

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-dff241-56c558c4bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dff241-56c558c4bb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-dff241-56c558c4bb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-dff241-56c558c4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dff241: serviceaccount "payload-processing-e2e-praxis-a-dff241" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-dff241

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-dff241-747567f57f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-dff241-747567f57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-dff241-747567f57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-dff241: serviceaccount "payload-processing-e2e-praxis-a-dff241" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e0f003

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e0f003

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e0f003: serviceaccount "payload-processing-e2e-ipp-b-e0f003" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e0f003: serviceaccount "payload-processing-e2e-ipp-b-e0f003" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e0f003-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e0f003-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-efbbc5-openshift-default-69965c4795

SuccessfulCreate

Created pod: e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-efbbc5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-efbbc5

openshift-ingress

deployment-controller

e2e-ipp-b-efbbc5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-efbbc5-openshift-default-69965c4795 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efbbc5-766bc8844

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-efbbc5-766bc8844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efbbc5: serviceaccount "payload-processing-e2e-ipp-b-efbbc5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efbbc5: serviceaccount "payload-processing-e2e-ipp-b-efbbc5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efbbc5-766bc8844

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-efbbc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-efbbc5-766bc8844 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-efbbc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d6c536-584f8cd944-djv74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d6c536-6cd8f8f567-8kdjx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d6c536-openshift-default-5fcfcf5b5-wq4tx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04fdf3-cdc8f8747-hqvkv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04fdf3-654b554d84-nz2qq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-5786848cf8-nkkqz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-04fdf3-openshift-default-c7b5c969c-5tnkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-57d64dd87-ttdbm

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a1e5d5-566c96f799-wtvb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a1e5d5-798584d5c8-k8xcn

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b03a5e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-a1e5d5-openshift-default-6b8bf98475-nf9g5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b03a5e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-91a20d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-91a20d

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e0f003-7dfc74fcf5-c9b78

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e0f003-7b46ddc7b4-k8ctd

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-a-91a20d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-91a20d-openshift-default-6c5dcdc445 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445

SuccessfulCreate

Created pod: e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

openshift-ingress

multus

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b03a5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b03a5e: serviceaccount "payload-processing-e2e-ipp-b-b03a5e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b03a5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b03a5e: serviceaccount "payload-processing-e2e-ipp-b-b03a5e" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-4d9a1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-4d9a1a

openshift-ingress

deployment-controller

e2e-praxis-b-4d9a1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-4d9a1a-openshift-default-6fc54594f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f

SuccessfulCreate

Created pod: e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

openshift-ingress

multus

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-91a20d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-91a20d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-91a20d: serviceaccount "payload-processing-e2e-praxis-a-91a20d" not found

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-91a20d: serviceaccount "payload-processing-e2e-praxis-a-91a20d" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-5c9df5486c-l5jxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-766bc8844-26ln4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-e0f003-openshift-default-7f5975bd9c-zd7h5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-a-7ce670-openshift-default-7948fc4f65

SuccessfulCreate

Created pod: e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

openshift-ingress

deployment-controller

e2e-praxis-a-7ce670-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-7ce670-openshift-default-7948fc4f65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-7ce670

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-7ce670

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

openshift-ingress

multus

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-4d9a1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-4d9a1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4d9a1a: serviceaccount "payload-processing-e2e-praxis-b-4d9a1a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-4d9a1a: serviceaccount "payload-processing-e2e-praxis-b-4d9a1a" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efbbc5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efbbc5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b03a5e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b03a5e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-7ce670

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-7ce670-6575556d44 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7ce670-6575556d44

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-7ce670-6575556d44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7ce670: serviceaccount "payload-processing-e2e-praxis-a-7ce670" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7ce670-6575556d44

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7ce670: serviceaccount "payload-processing-e2e-praxis-a-7ce670" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-7ce670

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9p5qn
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dff241-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-dff241-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.919s (2.919s including waiting). Image size: 185476477 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-efbbc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-efbbc5-64b4965578 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-efbbc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efbbc5-64b4965578

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efbbc5: serviceaccount "payload-processing-e2e-ipp-b-efbbc5" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-efbbc5-64b4965578

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-efbbc5-64b4965578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-efbbc5: serviceaccount "payload-processing-e2e-ipp-b-efbbc5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efbbc5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-efbbc5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-499bca-57d6795ff9-mftcs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-499bca-67c4f5d754-x4779

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-b-3eea00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3eea00-openshift-default-bc8f4888f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-3eea00-openshift-default-bc8f4888f

SuccessfulCreate

Created pod: e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-3eea00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-3eea00

openshift-ingress

multus

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Unhealthy

Readiness probe failed: Get "http://10.133.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

ProbeError

Readiness probe error: Get "http://10.133.0.149:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-499bca-openshift-default-769dd4644c-7vvll

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3eea00-5b99fb66db

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-3eea00-5b99fb66db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3eea00: serviceaccount "payload-processing-e2e-praxis-b-3eea00" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3eea00: serviceaccount "payload-processing-e2e-praxis-b-3eea00" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-3eea00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-3eea00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-3eea00-5b99fb66db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Unhealthy

Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3eea00-5b99fb66db

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

ProbeError

Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 3 to 2
(x5)

openshift-ingress

kubelet

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulDelete

Deleted pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-xxvnp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ce670-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ce670-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ad5839

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ad5839

openshift-ingress

multus

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-ad5839-openshift-default-ff4b8c565

SuccessfulCreate

Created pod: e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

openshift-ingress

deployment-controller

e2e-praxis-b-ad5839-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ad5839-openshift-default-ff4b8c565 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-dff241-747567f57f-gjtkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-dff241-56c558c4bb-zq9mn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b03a5e-6b6fcd7b5b-4t5s6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b03a5e-6c764b9767-xxvb4

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad5839-8578776659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ad5839

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ad5839-8578776659 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad5839-8578776659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ad5839-8578776659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad5839: serviceaccount "payload-processing-e2e-praxis-b-ad5839" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad5839-6cd595b74b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ad5839-6cd595b74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad5839: serviceaccount "payload-processing-e2e-praxis-b-ad5839" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad5839-6cd595b74b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ad5839

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ad5839-6cd595b74b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4d9a1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4d9a1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-b03a5e-openshift-default-6b4c88bd4f-mb29b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-194506

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-194506

openshift-ingress

deployment-controller

e2e-praxis-a-194506-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-194506-openshift-default-7fb974bc9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-194506-openshift-default-7fb974bc9c

SuccessfulCreate

Created pod: e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

openshift-ingress

multus

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-194506

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-194506-6796d89f95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-194506-6796d89f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-194506-6796d89f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-194506-6796d89f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-194506: serviceaccount "payload-processing-e2e-praxis-a-194506" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-194506

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-194506-5d7c4bb67d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-194506-5d7c4bb67d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-194506-5d7c4bb67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-194506: serviceaccount "payload-processing-e2e-praxis-a-194506" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-91a20d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-91a20d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-194506-5d7c4bb67d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4d9a1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-4d9a1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ce670-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ce670-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

ProbeError

Readiness probe error: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-dff241-openshift-default-789f678dc7-tgghz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Unhealthy

Readiness probe failed: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-4d9a1a-6d9b967d98-8jdtl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-4d9a1a-7d956cb475-8m2lq

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3eea00-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3eea00-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

ProbeError

Readiness probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Unhealthy

Readiness probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-91a20d-84dc8c9dbb-ngshh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-91a20d-764f5d9b79-hk8pn

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

ProbeError

Startup probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Unhealthy

Startup probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-194506-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-194506-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-91a20d-openshift-default-6c5dcdc445-mskkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-4d9a1a-openshift-default-6fc54594f-slfh8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3eea00-6cf79858d7-jpfcj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3eea00-5b99fb66db-m4fxb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ce670-6575556d44-b6d5l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ce670-5c54c796c9-v5zz8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-praxis-b-dc3196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-dc3196-openshift-default-5d5df65f49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-dc3196

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-dc3196

openshift-ingress

replicaset-controller

e2e-praxis-b-dc3196-openshift-default-5d5df65f49

SuccessfulCreate

Created pod: e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

openshift-ingress

multus

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3eea00-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3eea00-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-dc3196-77444cb88b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-dc3196-77444cb88b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-dc3196: serviceaccount "payload-processing-e2e-praxis-b-dc3196" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-dc3196: serviceaccount "payload-processing-e2e-praxis-b-dc3196" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-dc3196

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-dc3196

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-dc3196-77444cb88b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-dc3196-77444cb88b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Unhealthy

Readiness probe failed: Get "http://10.133.0.152:15021/healthz/ready": read tcp 10.133.0.2:47114->10.133.0.152:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

ProbeError

Readiness probe error: Get "http://10.133.0.152:15021/healthz/ready": read tcp 10.133.0.2:47114->10.133.0.152:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-6c106c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6c106c-openshift-default-667dbc4649 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6c106c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-6c106c-openshift-default-667dbc4649

SuccessfulCreate

Created pod: e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

Started

Container started

openshift-ingress

multus

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

Unhealthy

Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

ProbeError

Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-3eea00-openshift-default-bc8f4888f-sm95l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad5839-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad5839-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-7ce670-openshift-default-7948fc4f65-8glh2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad5839-6cd595b74b-6p2rs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad5839-8578776659-dmsxx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

Started

Container started

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-hcwvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-r9z2t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-hcwvj
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-6vq44

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-6vq44

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-r9z2t
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

ProbeError

Readiness probe error: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Unhealthy

Readiness probe failed: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-194506-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-194506-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-ad5839-openshift-default-ff4b8c565-z726m

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

Unhealthy

Readiness probe failed: dial tcp 10.133.0.142:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

Unhealthy

Readiness probe failed: dial tcp 10.133.0.141:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6c106c-56867c7b67-hdh9l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6c106c-695c8457d4-jh9t5

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulCreate

Created pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

Created

Container created

openshift-ingress

multus

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-twpcc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6c106c-openshift-default-667dbc4649-z5tft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-efbbc5-64b4965578-q8pr8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-efbbc5-7698f8c7cf-mntw5

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 4 to 6

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

Created

Container created

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulCreate

Created pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

Created

Container created

openshift-ingress

multus

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-efbbc5-openshift-default-69965c4795-6wk4b

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-dc3196-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-dc3196-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-a-65f21d-openshift-default-869884d6b5

SuccessfulCreate

Created pod: e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

openshift-ingress

deployment-controller

e2e-praxis-a-65f21d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-65f21d-openshift-default-869884d6b5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-65f21d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-65f21d

openshift-ingress

multus

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

ProbeError

Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

Unhealthy

Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-65f21d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-65f21d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-65f21d: serviceaccount "payload-processing-e2e-praxis-a-65f21d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-65f21d: serviceaccount "payload-processing-e2e-praxis-a-65f21d" not found

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulCreate

Created pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 6 to 8

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

Started

Container started

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

Started

Container started

openshift-ingress

multus

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulCreate

Created pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-b-773fbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-773fbb-openshift-default-f69b4fdb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-773fbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-773fbb

openshift-ingress

replicaset-controller

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5

SuccessfulCreate

Created pod: e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

openshift-ingress

multus

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-773fbb: serviceaccount "payload-processing-e2e-praxis-b-773fbb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-773fbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-773fbb-65884f8944 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-773fbb-65884f8944

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-773fbb-65884f8944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-773fbb: serviceaccount "payload-processing-e2e-praxis-b-773fbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-773fbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-773fbb-7f486964c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-773fbb-65884f8944

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-65f21d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-65f21d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

Unhealthy

Startup probe failed: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

ProbeError

Startup probe error: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-773fbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-773fbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-65f21d-7c58f4bf4d-rr67v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-65f21d-8477fc7bcf-n92qp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9lv85

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-9lv85

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-194506-6796d89f95-ckkhd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-194506-5d7c4bb67d-br4cc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-65f21d-openshift-default-869884d6b5-r6zk4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

ProbeError

Readiness probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-194506-openshift-default-7fb974bc9c-zrkmj

Unhealthy

Readiness probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-dc3196-6778b444ff-mgsg7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-dc3196-77444cb88b-c28pr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-dc3196-openshift-default-5d5df65f49-j2cdm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-773fbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-773fbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-773fbb-7f486964c-cpcl6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.118:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-773fbb-65884f8944-njspd

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.119:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-praxis-b-773fbb-openshift-default-f69b4fdb5-6m9wb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9p5qn

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9p5qn

openshift-ingress

multus

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-3c874f-openshift-default-75f5654dfc

SuccessfulCreate

Created pod: e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

openshift-ingress

deployment-controller

e2e-worker-w3-3c874f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3c874f-openshift-default-75f5654dfc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3c874f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e44313-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-e44313-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e44313-openshift-default-d5f88445f from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-e44313-openshift-default-d5f88445f

SuccessfulDelete

Deleted pod: e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-6w5wg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w2-2d5b09-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-2d5b09-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49

SuccessfulDelete

Deleted pod: e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-zgbkq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-k6nmr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-k6nmr
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-gkhfx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 5 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-h6l2s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-z5jpf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8pwsn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-8xm95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-x4g8l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulDelete

Deleted pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulDelete

Deleted pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-gtzl6

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 5 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulDelete

Deleted pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-pwltn

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-8cq5h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5

SuccessfulCreate

Created pod: e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

openshift-ingress

deployment-controller

e2e-shared-a-w1-1a1b45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-da4553

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-da4553

openshift-ingress

deployment-controller

e2e-shared-a-w3-da4553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf

SuccessfulCreate

Created pod: e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-1a1b45

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-1a1b45

openshift-ingress

multus

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-da4553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-da4553-55bd84f98

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-wgssk

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-da4553-55bd84f98

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-da4553-55bd84f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-da4553: serviceaccount "payload-processing-e2e-shared-a-w3-da4553" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 4 to 3
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-da4553: serviceaccount "payload-processing-e2e-shared-a-w3-da4553" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-da4553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-da4553-55bd84f98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-1a1b45: serviceaccount "payload-processing-e2e-shared-a-w1-1a1b45" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-1a1b45

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-1a1b45: serviceaccount "payload-processing-e2e-shared-a-w1-1a1b45" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-1a1b45

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-7d99a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-7d99a4

openshift-ingress

deployment-controller

e2e-shared-a-w4-7d99a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7

SuccessfulCreate

Created pod: e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

openshift-ingress

multus

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-7d99a4: serviceaccount "payload-processing-e2e-shared-a-w4-7d99a4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-7d99a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-7d99a4: serviceaccount "payload-processing-e2e-shared-a-w4-7d99a4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-7d99a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9

SuccessfulCreate

Created pod: e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-6ad168

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-6ad168

openshift-ingress

deployment-controller

e2e-shared-a-w0-6ad168-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-6ad168-openshift-default-7987d79df9 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-547a78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-6ad168

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-6ad168

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-547a78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-547a78

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-6ad168: serviceaccount "payload-processing-e2e-shared-a-w0-6ad168" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-6ad168: serviceaccount "payload-processing-e2e-shared-a-w0-6ad168" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e1a0c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e1a0c2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87

SuccessfulCreate

Created pod: e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

openshift-ingress

replicaset-controller

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff

SuccessfulCreate

Created pod: e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

openshift-ingress

deployment-controller

e2e-shared-b-w3-e1a0c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

ProbeError

Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Unhealthy

Readiness probe failed: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Unhealthy

Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

ProbeError

Readiness probe error: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e1a0c2: serviceaccount "payload-processing-e2e-shared-b-w3-e1a0c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e1a0c2: serviceaccount "payload-processing-e2e-shared-b-w3-e1a0c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e1a0c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e1a0c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-547a78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-547a78: serviceaccount "payload-processing-e2e-shared-b-w1-547a78" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-547a78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-547a78: serviceaccount "payload-processing-e2e-shared-b-w1-547a78" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

ProbeError

Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Unhealthy

Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-da4553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-da4553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-1a1b45-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-1a1b45-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-852107

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-852107

openshift-ingress

deployment-controller

e2e-shared-b-w4-852107-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-852107-openshift-default-dbf795c59 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w4-852107-openshift-default-dbf795c59

SuccessfulCreate

Created pod: e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-da4553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-da4553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-852107

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-852107

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-852107-5d944d8796 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-852107-5d944d8796

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-852107-5d944d8796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-852107: serviceaccount "payload-processing-e2e-shared-b-w4-852107" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-852107-5d944d8796

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-852107: serviceaccount "payload-processing-e2e-shared-b-w4-852107" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-817531

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-817531

openshift-ingress

deployment-controller

e2e-shared-b-w0-817531-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-817531-openshift-default-5b6ff899bc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc

SuccessfulCreate

Created pod: e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

openshift-ingress

multus

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-817531

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-817531: serviceaccount "payload-processing-e2e-shared-b-w0-817531" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-817531: serviceaccount "payload-processing-e2e-shared-b-w0-817531" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-817531

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Unhealthy

Readiness probe failed: Get "http://10.133.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

ProbeError

Readiness probe error: Get "http://10.133.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-1a1b45-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-547a78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-1a1b45-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-547a78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Unhealthy

Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

ProbeError

Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

ProbeError

Startup probe error: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Unhealthy

Startup probe failed: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6ad168-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6ad168-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-2c7g7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6ad168-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6ad168-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fcd5v

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-fcd5v
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-e1a0c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-547a78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-547a78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-e1a0c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-852107-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-852107-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

ProbeError

Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

Unhealthy

Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5

SuccessfulCreate

Created pod: e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

openshift-ingress

multus

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-817531-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-817531-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-817531-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-817531-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-852107-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-852107-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7

SuccessfulCreate

Created pod: e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

openshift-ingress

multus

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

Unhealthy

Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

ProbeError

Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-explicit-75c2b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-75c2b0-openshift-default-65fffb95d5 from 0 to 1

openshift-ingress

multus

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-75c2b0-openshift-default-65fffb95d5

SuccessfulCreate

Created pod: e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

openshift-ingress

gateway_labeler_controller

e2e-explicit-75c2b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-75c2b0

openshift-ingress

multus

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-75c2b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-75c2b0-69456d9fc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-75c2b0-69456d9fc6

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-75c2b0-69456d9fc6

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-75c2b0-69456d9fc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-75c2b0: serviceaccount "payload-processing-e2e-explicit-75c2b0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-75c2b0: serviceaccount "payload-processing-e2e-explicit-75c2b0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

openshift-ingress

kubelet

payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-75c2b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Unhealthy

Readiness probe failed: Get "http://10.133.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

ProbeError

Readiness probe error: Get "http://10.133.0.193:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-75c2b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-75c2b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-75c2b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-75c2b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7579-ad8907

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7579-ad8907

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7579-ad8907

Started

Container started

opendatahub

kubelet

test-curl-7579-ad8907

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.904s (1.904s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7579-ad8907

Created

Container created

opendatahub

multus

test-curl-7579-a28246

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7579-a28246

Created

Container created

opendatahub

kubelet

test-curl-7579-a28246

Started

Container started

opendatahub

kubelet

test-curl-7579-a28246

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7579-ad8907

Killing

Stopping container test-curl-7579-ad8907

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75c2b0-7fd559b87f-n95fj

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7579-18c4cb

Started

Container started

opendatahub

kubelet

test-curl-7579-18c4cb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-75c2b0-69456d9fc6-g95m9

Killing

Stopping container payload-processing

opendatahub

multus

test-curl-7579-18c4cb

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7579-18c4cb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7579-a28246

Killing

Stopping container test-curl-7579-a28246

opendatahub

kubelet

test-curl-7579-f96b2a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7579-f96b2a

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7579-f96b2a

Created

Container created

opendatahub

kubelet

test-curl-7579-f96b2a

Started

Container started

opendatahub

kubelet

test-curl-7579-18c4cb

Killing

Stopping container test-curl-7579-18c4cb

opendatahub

kubelet

test-curl-7579-fc70fd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7579-fc70fd

Created

Container created

opendatahub

kubelet

test-curl-7579-fc70fd

Started

Container started

opendatahub

multus

test-curl-7579-fc70fd

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7579-f96b2a

Killing

Stopping container test-curl-7579-f96b2a

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-689bcf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-689bcf

opendatahub

kubelet

test-curl-7579-fc70fd

Killing

Stopping container test-curl-7579-fc70fd

openshift-ingress

replicaset-controller

e2e-extmod-a-689bcf-openshift-default-7f7f54598f

SuccessfulCreate

Created pod: e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

openshift-ingress

multus

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-689bcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-689bcf-openshift-default-7f7f54598f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-689bcf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-689bcf-59fdddd88d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-689bcf-59fdddd88d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-689bcf-59fdddd88d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-689bcf-59fdddd88d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-689bcf: serviceaccount "payload-processing-e2e-extmod-a-689bcf" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-689bcf: serviceaccount "payload-processing-e2e-extmod-a-689bcf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-689bcf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7573-211a06

Created

Container created

opendatahub

kubelet

test-curl-7573-211a06

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7573-211a06

Started

Container started

opendatahub

multus

test-curl-7573-211a06

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7573-211a06

Killing

Stopping container test-curl-7573-211a06

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-9d8692

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-9d8692

openshift-ingress

multus

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-75c2b0-openshift-default-65fffb95d5-s6svr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-9d8692-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9d8692-openshift-default-6b89b6489 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-9d8692-openshift-default-6b89b6489

SuccessfulCreate

Created pod: e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

openshift-ingress

kubelet

e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

Started

Container started

openshift-ingress

kubelet

e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

Created

Container created

openshift-ingress

multus

e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-22aeb4-openshift-default-698fcbb6bf

SuccessfulCreate

Created pod: e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

openshift-ingress

deployment-controller

e2e-noten-22aeb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-22aeb4-openshift-default-698fcbb6bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-22aeb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-22aeb4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-9d8692

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9d8692-79b5454cb4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-9d8692-79b5454cb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9d8692: serviceaccount "payload-processing-e2e-extmod-a-9d8692" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9d8692-79b5454cb4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-9d8692

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-9d8692-79b5454cb4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9d8692: serviceaccount "payload-processing-e2e-extmod-a-9d8692" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-22aeb4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-22aeb4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7570-9a214b

Created

Container created

opendatahub

kubelet

test-curl-7570-9a214b

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7570-9a214b

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7570-9a214b

Started

Container started

opendatahub

kubelet

test-curl-7570-9a214b

Killing

Stopping container test-curl-7570-9a214b

openshift-ingress

kubelet

e2e-noten-22aeb4-openshift-default-698fcbb6bf-7ktks

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-35f43f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-35f43f

openshift-ingress

deployment-controller

e2e-extmod-b-35f43f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f

SuccessfulCreate

Created pod: e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

openshift-ingress

multus

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-e10c0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e10c0f-openshift-default-85f98fbc77 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-35f43f: serviceaccount "payload-processing-e2e-extmod-b-35f43f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-35f43f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-35f43f-8458dfc69b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-35f43f-8458dfc69b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-35f43f: serviceaccount "payload-processing-e2e-extmod-b-35f43f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-35f43f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-35f43f-8458dfc69b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-e10c0f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-e10c0f

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

openshift-ingress

multus

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-35f43f-8458dfc69b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

openshift-ingress

replicaset-controller

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77

SuccessfulCreate

Created pod: e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

openshift-ingress

multus

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

ProbeError

Readiness probe error: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Unhealthy

Readiness probe failed: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e10c0f-64b64759f4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-e10c0f-64b64759f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e10c0f: serviceaccount "payload-processing-e2e-extmod-a-e10c0f" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-e10c0f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e10c0f: serviceaccount "payload-processing-e2e-extmod-a-e10c0f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-e10c0f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-e10c0f-64b64759f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e10c0f-64b64759f4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3c874f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-3c874f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-3c874f-openshift-default-75f5654dfc from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-3c874f-openshift-default-75f5654dfc

SuccessfulDelete

Deleted pod: e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-f4vw4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-93b821-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-93b821-openshift-default-6bfd44fd77 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-8d80b1-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-93b821

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-93b821

openshift-ingress

replicaset-controller

e2e-extmod-b-93b821-openshift-default-6bfd44fd77

SuccessfulCreate

Created pod: e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

openshift-ingress

deployment-controller

e2e-worker-w4-8d80b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-8d80b1-openshift-default-75f5688b99 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-8d80b1-openshift-default-75f5688b99

SuccessfulDelete

Deleted pod: e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Unhealthy

Startup probe failed: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

ProbeError

Startup probe error: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-autores-dbed6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-dbed6d-openshift-default-7bcf6b6bdf from 0 to 1

openshift-ingress

multus

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf

SuccessfulCreate

Created pod: e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

openshift-ingress

gateway_labeler_controller

e2e-autores-dbed6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-dbed6d

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-wkqvl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9d8692-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9d8692-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-93b821: serviceaccount "payload-processing-e2e-extmod-b-93b821" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-93b821-7f884d5c88

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-93b821-7f884d5c88-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-93b821: serviceaccount "payload-processing-e2e-extmod-b-93b821" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-93b821

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-93b821-867684b6c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-93b821-7f884d5c88

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-93b821

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-93b821-7f884d5c88 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-dbed6d: serviceaccount "payload-processing-e2e-autores-dbed6d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-dbed6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-dbed6d-54984d74c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-dbed6d-54984d74c8

FailedCreate

Error creating: pods "payload-processing-e2e-autores-dbed6d-54984d74c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-dbed6d: serviceaccount "payload-processing-e2e-autores-dbed6d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-dbed6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-dbed6d-5d9898d5f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-dbed6d-54984d74c8

SuccessfulCreate

Created pod: payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

openshift-ingress

kubelet

payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-398c25-openshift-default-758b69476f

SuccessfulCreate

Created pod: e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-398c25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-398c25

openshift-ingress

deployment-controller

e2e-extmod-a-398c25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-398c25-openshift-default-758b69476f from 0 to 1

openshift-ingress

multus

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-398c25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-398c25-654bf4cb5b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-398c25-654bf4cb5b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-398c25: serviceaccount "payload-processing-e2e-extmod-a-398c25" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-398c25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-398c25-654bf4cb5b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-398c25-654bf4cb5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-398c25: serviceaccount "payload-processing-e2e-extmod-a-398c25" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9d8692-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9d8692-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-398c25-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-398c25-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e10c0f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e10c0f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

ProbeError

Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

Unhealthy

Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Unhealthy

Startup probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

ProbeError

Startup probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

AddedInterface

Add eth0 [10.133.0.212/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-372480-openshift-default-85c46d7765

SuccessfulCreate

Created pod: e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

openshift-ingress

deployment-controller

e2e-extmod-b-372480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-372480-openshift-default-85c46d7765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-372480

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-372480
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-35f43f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-35f43f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-372480

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-372480-7589999f7d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-372480

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-372480-7cd44b98c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-372480-7589999f7d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-372480-7589999f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-372480: serviceaccount "payload-processing-e2e-extmod-b-372480" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-372480-7589999f7d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-372480: serviceaccount "payload-processing-e2e-extmod-b-372480" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e10c0f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e10c0f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93b821-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93b821-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-35f43f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-35f43f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dbed6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dbed6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

Unhealthy

Startup probe failed: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

ProbeError

Startup probe error: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-855e14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-855e14-openshift-default-5c9588dcd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulCreate

Created pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-855e14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-855e14

openshift-ingress

multus

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-855e14-56ff45ddcd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-855e14-56ff45ddcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-855e14: serviceaccount "payload-processing-e2e-extmod-b-855e14" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-855e14-56ff45ddcd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-855e14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-855e14-56ff45ddcd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-855e14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-855e14: serviceaccount "payload-processing-e2e-extmod-b-855e14" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-398c25-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-398c25-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93b821-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-93b821-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dbed6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dbed6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

Unhealthy

Startup probe failed: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

ProbeError

Startup probe error: Get "http://10.133.0.212:15021/healthz/ready": dial tcp 10.133.0.212:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dbed6d-5d9898d5f-g7jx9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-dbed6d-54984d74c8-4cb44

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

Started

Container started

openshift-ingress

multus

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-855e14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-855e14-openshift-default-5c9588dcd9 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulCreate

Created pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulCreate

Created pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulCreate

Created pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

Created

Container created

openshift-ingress

multus

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Unhealthy

Readiness probe failed: Get "http://10.133.0.213:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

ProbeError

Readiness probe error: Get "http://10.133.0.213:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Unhealthy

Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

ProbeError

Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

ProbeError

Startup probe error: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

Unhealthy

Startup probe failed: Get "http://10.133.0.218:15021/healthz/ready": dial tcp 10.133.0.218:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

ProbeError

Readiness probe error: Get "http://10.133.0.199:15021/healthz/ready": read tcp 10.133.0.2:48528->10.133.0.199:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Unhealthy

Readiness probe failed: Get "http://10.133.0.199:15021/healthz/ready": read tcp 10.133.0.2:48528->10.133.0.199:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Unhealthy

Startup probe failed: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

ProbeError

Startup probe error: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-dbed6d-openshift-default-7bcf6b6bdf-bvq6j

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Unhealthy

Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-pgmcn

openshift-ingress

deployment-controller

e2e-extmod-a-441461-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-441461-openshift-default-7cdc576fc7 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

ProbeError

Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-441461

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-441461

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-441461-openshift-default-7cdc576fc7

SuccessfulCreate

Created pod: e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-441461-54857d6695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-441461-54857d6695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-441461-54857d6695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-441461: serviceaccount "payload-processing-e2e-extmod-a-441461" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-441461-5bd69b7b5b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-441461-5bd69b7b5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-441461: serviceaccount "payload-processing-e2e-extmod-a-441461" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-441461

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-441461-54857d6695 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-441461-5bd69b7b5b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-441461

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-441461-5bd69b7b5b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-689bcf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-689bcf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-441461-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-441461-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-81afe3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-81afe3

openshift-ingress

replicaset-controller

e2e-extmod-b-81afe3-openshift-default-9c5c4c49

SuccessfulCreate

Created pod: e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

openshift-ingress

deployment-controller

e2e-extmod-b-81afe3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-81afe3-openshift-default-9c5c4c49 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-81afe3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-81afe3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-81afe3: serviceaccount "payload-processing-e2e-extmod-b-81afe3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-81afe3: serviceaccount "payload-processing-e2e-extmod-b-81afe3" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-441461-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-441461-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-398c25-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-398c25-openshift-default-758b69476f

SuccessfulCreate

Created pod: e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

openshift-ingress

deployment-controller

e2e-extmod-a-398c25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-398c25-openshift-default-758b69476f from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

Started

Container started

openshift-ingress

multus

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

Unhealthy

Startup probe failed: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

ProbeError

Startup probe error: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Unhealthy

Readiness probe failed: Get "http://10.134.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

ProbeError

Readiness probe error: Get "http://10.134.0.165:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7b6f7fb4f5

FailedCreate

Error creating: pods "payload-processing-external-model-7b6f7fb4f5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7b6f7fb4f5 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7b6f7fb4f5

SuccessfulCreate

Created pod: payload-processing-external-model-7b6f7fb4f5-z4gp4

models-as-a-service

multus

payload-processing-external-model-7b6f7fb4f5-z4gp4

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7b6f7fb4f5-z4gp4

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7b6f7fb4f5-z4gp4

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-81afe3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

kubelet

payload-processing-external-model-7b6f7fb4f5-z4gp4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-81afe3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-81afe3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-81afe3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bf6f9f

SuccessfulCreate

Created pod: payload-processing-external-model-d5bf6f9f-dmvrs

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-dmvrs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-dmvrs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-d5bf6f9f-dmvrs

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-dmvrs

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-67d95c9c8 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-67d95c9c8-n62m7

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-67d95c9c8-n62m7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-67d95c9c8

SuccessfulCreate

Created pod: payload-processing-external-model-67d95c9c8-n62m7

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bf6f9f

SuccessfulDelete

Deleted pod: payload-processing-external-model-d5bf6f9f-dmvrs

models-as-a-service

kubelet

payload-processing-external-model-67d95c9c8-n62m7

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-dmvrs

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-67d95c9c8-n62m7

Created

Container created
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d5bf6f9f from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-67d95c9c8-n62m7

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-67d95c9c8 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bf6f9f

SuccessfulCreate

Created pod: payload-processing-external-model-d5bf6f9f-64gcz

models-as-a-service

replicaset-controller

payload-processing-external-model-67d95c9c8

SuccessfulDelete

Deleted pod: payload-processing-external-model-67d95c9c8-n62m7

models-as-a-service

multus

payload-processing-external-model-d5bf6f9f-64gcz

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-64gcz

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-64gcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-64gcz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 2 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-wgghh

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-zkqzg
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-d5bf6f9f-64gcz

Killing

Stopping container payload-processing
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d5bf6f9f from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bf6f9f

SuccessfulDelete

Deleted pod: payload-processing-external-model-d5bf6f9f-64gcz
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-54bdbcb9db

SuccessfulCreate

Created pod: payload-processing-external-model-54bdbcb9db-kxlgg
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-54bdbcb9db from 0 to 1

models-as-a-service

multus

payload-processing-external-model-54bdbcb9db-kxlgg

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-54bdbcb9db-kxlgg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-54bdbcb9db-kxlgg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-54bdbcb9db-kxlgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-88m6n

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7b6f7fb4f5-z4gp4

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7b6f7fb4f5

SuccessfulDelete

Deleted pod: payload-processing-external-model-7b6f7fb4f5-z4gp4

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7b6f7fb4f5 from 1 to 0
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Unhealthy

Startup probe failed: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

ProbeError

Startup probe error: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

Unhealthy

Startup probe failed: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

ProbeError

Startup probe error: Get "http://10.133.0.244:15021/healthz/ready": dial tcp 10.133.0.244:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Unhealthy

Readiness probe failed: Get "http://10.134.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

ProbeError

Readiness probe error: Get "http://10.134.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Unhealthy

Startup probe failed: Get "http://10.133.0.245:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

ProbeError

Startup probe error: Get "http://10.133.0.245:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-54bdbcb9db-kxlgg

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bc757568 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc757568

FailedCreate

Error creating: pods "payload-processing-external-model-5bc757568-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc757568

SuccessfulCreate

Created pod: payload-processing-external-model-5bc757568-bkxtv

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-bkxtv

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5bc757568-bkxtv

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-bkxtv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-bkxtv

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-bkxtv

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc757568

SuccessfulCreate

Created pod: payload-processing-external-model-5bc757568-tjkvv
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc757568

FailedCreate

Error creating: pods "payload-processing-external-model-5bc757568-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bc757568 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-tjkvv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-tjkvv

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5bc757568-tjkvv

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-tjkvv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bc757568-tjkvv

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-ae0e75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ae0e75-openshift-default-545f855fd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-ae0e75-openshift-default-545f855fd9

SuccessfulCreate

Created pod: e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ae0e75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ae0e75

openshift-ingress

multus

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

AddedInterface

Add eth0 [10.133.0.249/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-lkn75

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 8 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ae0e75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ae0e75-c9bff5778 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77

SuccessfulCreate

Created pod: e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ae0e75-c9bff5778

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ae0e75-c9bff5778

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ae0e75-c9bff5778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ae0e75: serviceaccount "payload-processing-e2e-inf-a-ae0e75" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e10c0f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-e10c0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e10c0f-openshift-default-85f98fbc77 from 1 to 2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ae0e75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ae0e75: serviceaccount "payload-processing-e2e-inf-a-ae0e75" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d53363

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d53363

openshift-ingress

deployment-controller

e2e-inf-a-d53363-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d53363-openshift-default-5568f6bb59 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-d53363-openshift-default-5568f6bb59

SuccessfulCreate

Created pod: e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

openshift-ingress

multus

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-372480-openshift-default-85c46d7765

SuccessfulCreate

Created pod: e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

openshift-ingress

deployment-controller

e2e-extmod-b-372480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-372480-openshift-default-85c46d7765 from 1 to 2
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

Unhealthy

Startup probe failed: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

ProbeError

Startup probe error: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d53363

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d53363-54cbdbd459 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d53363: serviceaccount "payload-processing-e2e-inf-a-d53363" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d53363-54c7d449b4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d53363-54c7d449b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d53363: serviceaccount "payload-processing-e2e-inf-a-d53363" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d53363

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d53363-54c7d449b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d53363-54c7d449b4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

Unhealthy

Startup probe failed: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

ProbeError

Startup probe error: Get "http://10.134.0.188:15021/healthz/ready": dial tcp 10.134.0.188:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulDelete

Deleted pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pdjp6

openshift-ingress

deployment-controller

e2e-extmod-b-855e14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-855e14-openshift-default-5c9588dcd9 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

ProbeError

Readiness probe error: Get "http://10.134.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Unhealthy

Readiness probe failed: Get "http://10.134.0.186:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-inf-b-e84013-openshift-default-86489877f9

SuccessfulCreate

Created pod: e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e84013

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e84013

openshift-ingress

deployment-controller

e2e-inf-b-e84013-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e84013-openshift-default-86489877f9 from 0 to 1

openshift-ingress

multus

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

AddedInterface

Add eth0 [10.133.0.253/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e84013

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e84013-75b759bfb4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e84013

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e84013: serviceaccount "payload-processing-e2e-inf-b-e84013" not found

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Unhealthy

Readiness probe failed: Get "http://10.133.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e84013-75b759bfb4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e84013-75b759bfb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e84013: serviceaccount "payload-processing-e2e-inf-b-e84013" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e84013-75b759bfb4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

ProbeError

Readiness probe error: Get "http://10.133.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

AddedInterface

Add eth0 [10.133.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

AddedInterface

Add eth0 [10.133.0.255/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-35fc87-openshift-default-6c54f7865c

SuccessfulCreate

Created pod: e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

openshift-ingress

gateway_labeler_controller

e2e-inf-b-35fc87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-35fc87

openshift-ingress

deployment-controller

e2e-inf-b-35fc87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-35fc87-openshift-default-6c54f7865c from 0 to 1

openshift-ingress

multus

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

AddedInterface

Add eth0 [10.133.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Unhealthy

Readiness probe failed: Get "http://10.133.0.250:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

ProbeError

Readiness probe error: Get "http://10.133.0.250:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae0e75-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae0e75-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Unhealthy

Startup probe failed: Get "http://10.133.0.249:15021/healthz/ready": dial tcp 10.133.0.249:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

ProbeError

Startup probe error: Get "http://10.133.0.249:15021/healthz/ready": dial tcp 10.133.0.249:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-35fc87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-35fc87-784d6b744b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-35fc87: serviceaccount "payload-processing-e2e-inf-b-35fc87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-35fc87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-35fc87-784d6b744b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-35fc87-784d6b744b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-35fc87-784d6b744b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-35fc87: serviceaccount "payload-processing-e2e-inf-b-35fc87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-66f6857b97 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-66f6857b97

FailedCreate

Error creating: pods "payload-processing-external-model-66f6857b97-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found
(x5)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

ProbeError

Startup probe error: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused body:

models-as-a-service

multus

payload-processing-external-model-66f6857b97-np5bw

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-66f6857b97

SuccessfulCreate

Created pod: payload-processing-external-model-66f6857b97-np5bw
(x5)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Unhealthy

Startup probe failed: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-66f6857b97-np5bw

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-66f6857b97-np5bw

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-66f6857b97-np5bw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae0e75-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ae0e75-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

kubelet

payload-processing-external-model-66f6857b97-np5bw

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f

SuccessfulCreate

Created pod: e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

openshift-ingress

gateway_labeler_controller

e2e-inf-a-3cfed7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-3cfed7

openshift-ingress

deployment-controller

e2e-inf-a-3cfed7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-3cfed7-openshift-default-d98ff4c9f from 0 to 1

openshift-ingress

multus

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

AddedInterface

Add eth0 [10.133.1.3/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d53363-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d53363-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-3cfed7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-3cfed7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3cfed7: serviceaccount "payload-processing-e2e-inf-a-3cfed7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-3cfed7: serviceaccount "payload-processing-e2e-inf-a-3cfed7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3cfed7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3cfed7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-e84013-openshift-default-86489877f9

SuccessfulCreate

Created pod: e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

AddedInterface

Add eth0 [10.133.1.6/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-35fc87-openshift-default-6c54f7865c

SuccessfulCreate

Created pod: e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-e84013-openshift-default-86489877f9

SuccessfulCreate

Created pod: e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

openshift-ingress

replicaset-controller

e2e-inf-b-35fc87-openshift-default-6c54f7865c

SuccessfulCreate

Created pod: e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e84013-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-b-35fc87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-35fc87-openshift-default-6c54f7865c from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-e84013-openshift-default-86489877f9

SuccessfulCreate

Created pod: e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

openshift-ingress

multus

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-35fc87-openshift-default-6c54f7865c

SuccessfulCreate

Created pod: e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

openshift-ingress

deployment-controller

e2e-inf-b-e84013-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e84013-openshift-default-86489877f9 from 1 to 4

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-b-372480-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-372480-openshift-default-85c46d7765 from 2 to 3

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

AddedInterface

Add eth0 [10.133.1.7/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

Created

Container created

openshift-ingress

multus

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-372480-openshift-default-85c46d7765

SuccessfulCreate

Created pod: e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

Started

Container started

openshift-ingress

multus

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

ProbeError

Startup probe error: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

Unhealthy

Startup probe failed: Get "http://10.134.0.198:15021/healthz/ready": dial tcp 10.134.0.198:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

Unhealthy

Startup probe failed: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

ProbeError

Startup probe error: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

Unhealthy

Startup probe failed: Get "http://10.133.1.7:15021/healthz/ready": dial tcp 10.133.1.7:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

ProbeError

Startup probe error: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

ProbeError

Startup probe error: Get "http://10.133.1.7:15021/healthz/ready": dial tcp 10.133.1.7:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

Unhealthy

Startup probe failed: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

ProbeError

Startup probe error: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Unhealthy

Startup probe failed: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e84013-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e84013-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e84013-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e84013-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-inf-a-a3d585-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a3d585-openshift-default-85d97fc75f from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-a3d585-openshift-default-85d97fc75f

SuccessfulCreate

Created pod: e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a3d585

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a3d585

openshift-ingress

multus

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-35fc87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-35fc87-openshift-default-6c54f7865c from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e84013-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-e84013-openshift-default-86489877f9

SuccessfulCreate

Created pod: e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-e84013-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e84013-openshift-default-86489877f9 from 4 to 5

openshift-ingress

multus

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-35fc87-openshift-default-6c54f7865c

SuccessfulCreate

Created pod: e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a3d585

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a3d585: serviceaccount "payload-processing-e2e-inf-a-a3d585" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a3d585

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a3d585-5c77ff59cb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a3d585-5c77ff59cb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a3d585-5c77ff59cb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a3d585-5c77ff59cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a3d585: serviceaccount "payload-processing-e2e-inf-a-a3d585" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

Unhealthy

Startup probe failed: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

ProbeError

Startup probe error: Get "http://10.134.0.204:15021/healthz/ready": dial tcp 10.134.0.204:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

ProbeError

Startup probe error: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

Unhealthy

Startup probe failed: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9e0d09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9e0d09

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 0 to 1

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a3d585-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a3d585-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9e0d09-6d59559648

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9e0d09-6d59559648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9e0d09: serviceaccount "payload-processing-e2e-inf-b-9e0d09" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9e0d09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9e0d09: serviceaccount "payload-processing-e2e-inf-b-9e0d09" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9e0d09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9e0d09-6d59559648 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9e0d09-6d59559648

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

AddedInterface

Add eth0 [10.133.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3cfed7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-3cfed7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w4-7d99a4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7 from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-m4svw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-855e14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-855e14-openshift-default-5c9588dcd9 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulDelete

Deleted pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-p65hw

openshift-ingress

replicaset-controller

e2e-inf-a-0393ed-openshift-default-55b9654d67

SuccessfulCreate

Created pod: e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

openshift-ingress

gateway_labeler_controller

e2e-inf-a-0393ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0393ed

openshift-ingress

deployment-controller

e2e-inf-a-0393ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-0393ed-openshift-default-55b9654d67 from 0 to 1

openshift-ingress

multus

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 1 to 2

openshift-ingress

deployment-controller

e2e-shared-a-w1-1a1b45-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-1a1b45-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

openshift-ingress

replicaset-controller

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4206d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4206d9

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-b-4206d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4206d9-openshift-default-8ccdd7999 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-4206d9-openshift-default-8ccdd7999

SuccessfulCreate

Created pod: e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-0393ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-0393ed-7c7846fbcb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0393ed-7c7846fbcb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-0393ed-7c7846fbcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0393ed: serviceaccount "payload-processing-e2e-inf-a-0393ed" not found

openshift-ingress

multus

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

AddedInterface

Add eth0 [10.133.1.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0393ed-64994f786c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0393ed-64994f786c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-0393ed-64994f786c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0393ed: serviceaccount "payload-processing-e2e-inf-a-0393ed" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-0393ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-0393ed-64994f786c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0393ed-7c7846fbcb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

ProbeError

Readiness probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-jpdz7

Unhealthy

Readiness probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4206d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4206d9-6f8784957f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4206d9-c8d98bbb8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4206d9-c8d98bbb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4206d9: serviceaccount "payload-processing-e2e-inf-b-4206d9" not found
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Unhealthy

Readiness probe failed: Get "http://10.133.1.10:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4206d9: serviceaccount "payload-processing-e2e-inf-b-4206d9" not found
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4206d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4206d9-c8d98bbb8 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

ProbeError

Readiness probe error: Get "http://10.133.1.10:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4206d9-c8d98bbb8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

AddedInterface

Add eth0 [10.133.1.21/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-d53363-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-a-d53363-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d53363-openshift-default-5568f6bb59 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-d53363-openshift-default-5568f6bb59

SuccessfulCreate

Created pod: e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

Started

Container started

openshift-ingress

multus

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

Unhealthy

Startup probe failed: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

ProbeError

Startup probe error: Get "http://10.132.0.168:15021/healthz/ready": dial tcp 10.132.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

Unhealthy

Startup probe failed: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

ProbeError

Startup probe error: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

ProbeError

Startup probe error: Get "http://10.133.1.21:15021/healthz/ready": dial tcp 10.133.1.21:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

Unhealthy

Startup probe failed: Get "http://10.133.1.21:15021/healthz/ready": dial tcp 10.133.1.21:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Unhealthy

Startup probe failed: Get "http://10.133.1.10:15021/healthz/ready": dial tcp 10.133.1.10:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

ProbeError

Startup probe error: Get "http://10.133.1.10:15021/healthz/ready": dial tcp 10.133.1.10:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

Unhealthy

Startup probe failed: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

ProbeError

Startup probe error: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 4 to 8

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

Started

Container started

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

AddedInterface

Add eth0 [10.133.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a3d585-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a3d585-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

Unhealthy

Startup probe failed: Get "http://10.133.1.22:15021/healthz/ready": dial tcp 10.133.1.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

Unhealthy

Startup probe failed: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

ProbeError

Startup probe error: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

ProbeError

Startup probe error: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

ProbeError

Startup probe error: Get "http://10.133.1.22:15021/healthz/ready": dial tcp 10.133.1.22:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

Unhealthy

Startup probe failed: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

(combined from similar events): Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulCreate

Created pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 8 to 10

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

Created

Container created

openshift-ingress

multus

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

AddedInterface

Add eth0 [10.133.1.23/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

Unhealthy

Startup probe failed: Get "http://10.133.1.23:15021/healthz/ready": dial tcp 10.133.1.23:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

ProbeError

Startup probe error: Get "http://10.133.1.23:15021/healthz/ready": dial tcp 10.133.1.23:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b267f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b267f8

openshift-ingress

replicaset-controller

e2e-inf-b-b267f8-openshift-default-864488dc79

SuccessfulCreate

Created pod: e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

openshift-ingress

deployment-controller

e2e-inf-b-b267f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b267f8-openshift-default-864488dc79 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

ProbeError

Readiness probe error: Get "http://10.134.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Unhealthy

Readiness probe failed: Get "http://10.134.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

ProbeError

Readiness probe error: Get "http://10.133.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Unhealthy

Readiness probe failed: Get "http://10.133.1.20:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b267f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b267f8-799f4d5476

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b267f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b267f8-799f4d5476 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b267f8: serviceaccount "payload-processing-e2e-inf-b-b267f8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b267f8-799f4d5476

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b267f8-799f4d5476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b267f8: serviceaccount "payload-processing-e2e-inf-b-b267f8" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

AddedInterface

Add eth0 [10.133.1.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Unhealthy

Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

ProbeError

Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0393ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0393ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Unhealthy

Startup probe failed: Get "http://10.133.1.20:15021/healthz/ready": dial tcp 10.133.1.20:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

ProbeError

Startup probe error: Get "http://10.133.1.20:15021/healthz/ready": dial tcp 10.133.1.20:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4206d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4206d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4206d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-4206d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-ae0e75-openshift-default-545f855fd9-7n5bm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ae0e75-799dd5b95f-v7n4c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ae0e75-c9bff5778-g64mt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0393ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0393ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-9p4jh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-wgghh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-tvsnl

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-35fc87-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-35fc87-openshift-default-6c54f7865c from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-35fc87-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-35fc87-openshift-default-6c54f7865c

SuccessfulDelete

Deleted pod: e2e-inf-b-35fc87-openshift-default-6c54f7865c-7sb5z

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d53363-54c7d449b4-g9v6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e84013-75b759bfb4-dtf42

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.1.0:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e84013-7b65d6cb4c-fgz8h

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.255:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d53363-54cbdbd459-lmqtf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-vhdtm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-pzwsp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-ldw7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-cz5dh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-e84013-openshift-default-86489877f9-z2jqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-5nl48

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-d53363-openshift-default-5568f6bb59-r7xk8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

ProbeError

Readiness probe error: Get "http://10.133.1.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Unhealthy

Readiness probe failed: Get "http://10.133.1.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-ktnm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bp5f5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-kb8ms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-35fc87-openshift-default-6c54f7865c-bqmtm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-35fc87-787f7d88f9-dcrzl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-35fc87-784d6b744b-xp529

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b267f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b267f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

Unhealthy

Startup probe failed: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

ProbeError

Startup probe error: Get "http://10.134.0.220:15021/healthz/ready": dial tcp 10.134.0.220:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

Unhealthy

Startup probe failed: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

Unhealthy

Startup probe failed: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

ProbeError

Startup probe error: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

ProbeError

Startup probe error: Get "http://10.134.0.222:15021/healthz/ready": dial tcp 10.134.0.222:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-b267f8-openshift-default-864488dc79

SuccessfulCreate

Created pod: e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-b267f8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-b267f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b267f8-openshift-default-864488dc79 from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

Created

Container created

openshift-ingress

multus

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

ProbeError

Startup probe error: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

Unhealthy

Startup probe failed: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 10 to 8

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulDelete

Deleted pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-x4kxw

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulDelete

Deleted pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-zx49j

openshift-ingress

deployment-controller

e2e-extmod-b-855e14-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-855e14-openshift-default-5c9588dcd9 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-855e14-openshift-default-5c9588dcd9

SuccessfulDelete

Deleted pod: e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-855e14-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-a9c9b6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f

SuccessfulDelete

Deleted pod: e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a9c9b6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-l4k9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-372480-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-372480-openshift-default-85c46d7765 from 3 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-372480-openshift-default-85c46d7765

SuccessfulDelete

Deleted pod: e2e-extmod-b-372480-openshift-default-85c46d7765-p5kkz

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-bp7bc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-3cfed7-79c7bbd5bd-kff8c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-3cfed7-65c8bc9bdc-l6kzf

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.196:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-inf-a-3cfed7-openshift-default-d98ff4c9f-b7vww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9e0d09-6d59559648-rnwsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9e0d09-bc9b4cb4c-kwzp5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-inf-b-9e0d09-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-inf-b-9e0d09-openshift-default-db569dc47 from 8 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9e0d09-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-9e0d09-openshift-default-db569dc47

SuccessfulDelete

Deleted pod: e2e-inf-b-9e0d09-openshift-default-db569dc47-lv6bh

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-2vqg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-qtr25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-cnvwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-95cl6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tzn74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-tcpr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9e0d09-openshift-default-db569dc47-4h4mw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-e10c0f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-e10c0f-openshift-default-85f98fbc77 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e10c0f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77

SuccessfulDelete

Deleted pod: e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-lmf72
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a3d585-7965b5f54c-tjfrz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a3d585-5c77ff59cb-gwv82

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-a3d585-openshift-default-85d97fc75f-tnkp5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-1597f8bc-openshift-default-97d6dc64f

SuccessfulCreate

Created pod: e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

openshift-ingress

deployment-controller

e2e-mt-1597f8bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1597f8bc-openshift-default-97d6dc64f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-1597f8bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1597f8bc

openshift-ingress

multus

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

AddedInterface

Add eth0 [10.133.1.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1597f8bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1597f8bc-76db4dc74

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1597f8bc-76db4dc74

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1597f8bc-76db4dc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1597f8bc: serviceaccount "payload-processing-e2e-mt-1597f8bc" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1597f8bc: serviceaccount "payload-processing-e2e-mt-1597f8bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1597f8bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1597f8bc-76db4dc74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4206d9-c8d98bbb8-jbsv2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4206d9-6f8784957f-kqhr2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1597f8bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1597f8bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-4206d9-openshift-default-8ccdd7999-nrf5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0393ed-7c7846fbcb-nq52h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0393ed-64994f786c-cfxsf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-extmod-a-398c25-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-398c25-openshift-default-758b69476f from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-398c25-openshift-default-758b69476f

SuccessfulDelete

Deleted pod: e2e-extmod-a-398c25-openshift-default-758b69476f-9bqqx

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-398c25-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Unhealthy

Readiness probe failed: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

ProbeError

Readiness probe error: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-0393ed-openshift-default-55b9654d67-94749

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

ProbeError

Startup probe error: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Unhealthy

Startup probe failed: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-extmod-b-372480-openshift-default-85c46d7765

SuccessfulDelete

Deleted pod: e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-372480-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-372480-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-372480-openshift-default-85c46d7765 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-6rktn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b267f8-799f4d5476-r2dh6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.1.27:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b267f8-7c8c7dcc79-kg6gr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.216:50052" within 1s: context deadline exceeded
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1597f8bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-1597f8bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87

SuccessfulCreate

Created pod: e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-e1a0c2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w3-e1a0c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87 from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

AddedInterface

Add eth0 [10.133.1.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-c4lfg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-b267f8-openshift-default-864488dc79-st6ks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

Unhealthy

Startup probe failed: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

ProbeError

Startup probe error: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1597f8bc-6c6ccb9475-kgbjd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1597f8bc-76db4dc74-r4q2k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-1597f8bc-openshift-default-97d6dc64f-7hdkh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-30e3dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-30e3dd-openshift-default-fff78f985 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985

SuccessfulCreate

Created pod: e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-30e3dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-30e3dd

openshift-ingress

multus

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-30e3dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-30e3dd: serviceaccount "payload-processing-e2e-shared-a-w2-30e3dd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-30e3dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-30e3dd: serviceaccount "payload-processing-e2e-shared-a-w2-30e3dd" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

AddedInterface

Add eth0 [10.134.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7573-d95056

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7573-d95056

Created

Container created

opendatahub

kubelet

test-curl-7573-d95056

Started

Container started

opendatahub

multus

test-curl-7573-d95056

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7573-944894

Started

Container started

opendatahub

multus

test-curl-7573-944894

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7573-d95056

Killing

Stopping container test-curl-7573-d95056

opendatahub

kubelet

test-curl-7573-944894

Created

Container created

opendatahub

kubelet

test-curl-7573-944894

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7573-944894

Killing

Stopping container test-curl-7573-944894

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

e2e-shared-a-w1-1a1b45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-1a1b45-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5

SuccessfulCreate

Created pod: e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

ProbeError

Startup probe error: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

Unhealthy

Startup probe failed: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-441461-5bd69b7b5b-8cfln

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-441461-openshift-default-7cdc576fc7-7lszv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-441461-54857d6695-8gc5s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-81afe3-f7ffcd9f9-62qvk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-81afe3-7c44c5f4b6-2mk6m

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Unhealthy

Startup probe failed: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

ProbeError

Startup probe error: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w3-da4553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-da4553-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf

SuccessfulCreate

Created pod: e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-30e3dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-30e3dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

ProbeError

Startup probe error: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

Unhealthy

Startup probe failed: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-dd81fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-dd81fd

openshift-ingress

deployment-controller

e2e-shared-b-w2-dd81fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555

SuccessfulCreate

Created pod: e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

openshift-ingress

multus

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

AddedInterface

Add eth0 [10.133.1.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-dd81fd: serviceaccount "payload-processing-e2e-shared-b-w2-dd81fd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-dd81fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-dd81fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-dd81fd: serviceaccount "payload-processing-e2e-shared-b-w2-dd81fd" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-30e3dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-30e3dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-e1a0c2-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w1-547a78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87

SuccessfulCreate

Created pod: e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

openshift-ingress

replicaset-controller

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff

SuccessfulCreate

Created pod: e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-547a78-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-9d8692-openshift-default-6b89b6489-9gn62

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-e1a0c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87 from 2 to 3

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-81afe3-openshift-default-9c5c4c49-2sv2v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-689bcf-5dbc7c7775-gvzcx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-689bcf-59fdddd88d-xp56l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9d8692-5b77b85647-2g4kr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9d8692-79b5454cb4-fsbrv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-93b821-openshift-default-6bfd44fd77-sl2lw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-689bcf-openshift-default-7f7f54598f-bcpr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-93b821-867684b6c9-rrfgc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-93b821-7f884d5c88-xlj6z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6ad168-7b664c97b4-cr7bf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6ad168-848c96b775-wj48t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-6ad168-openshift-default-7987d79df9-7q7q4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-gh4qd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-1a1b45-6d8645dc58-2qkpn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-1a1b45-84568cdd5f-bq6zn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-1a1b45-openshift-default-67765b47b5-mj8d8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7

SuccessfulCreate

Created pod: e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9
(x2)

openshift-ingress

deployment-controller

e2e-shared-a-w4-7d99a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

Started

Container started

openshift-ingress

multus

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-35f43f-69d8b5d5b7-mjmvl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-35f43f-8458dfc69b-sl27j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

Unhealthy

Startup probe failed: Get "http://10.134.0.240:15021/healthz/ready": dial tcp 10.134.0.240:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

ProbeError

Startup probe error: Get "http://10.134.0.240:15021/healthz/ready": dial tcp 10.134.0.240:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-4qjdc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-547a78-openshift-default-67dbdf45ff-vkh9f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e10c0f-64b64759f4-pchdf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-35f43f-openshift-default-69bf4bcd4f-lh44t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-817531-5f8bb9b4c6-vzrml

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-817531-7bdf4dc867-r9h7x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-dd81fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-dd81fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-547a78-585cbc8c7b-t5sbv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e44313-596b94c9b-v6z85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

ProbeError

Startup probe error: Get "http://10.133.1.69:15021/healthz/ready": dial tcp 10.133.1.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Unhealthy

Startup probe failed: Get "http://10.133.1.69:15021/healthz/ready": dial tcp 10.133.1.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-547a78-5d6f566cf5-x5nl4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e44313-7f7d8f97b7-hnhf2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-e10c0f-openshift-default-85f98fbc77-rbztd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-817531-openshift-default-5b6ff899bc-clh62

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e10c0f-cbd8676c5-vbs59

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-r54vs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-da4553-openshift-default-6fcb679bdf-78hb7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-da4553-55bd84f98-4vmmr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-da4553-cb8bf6f67-7vnv9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-e44313-openshift-default-d5f88445f-xzlj7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-372480-7589999f7d-td2g2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-dd81fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-dd81fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-372480-7cd44b98c-cnzzj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-372480-openshift-default-85c46d7765-fdm9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a9c9b6-openshift-default-6fd8dbdb4f-rvkl5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a9c9b6-5c46996b86-fjh4j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a9c9b6-7d594f9c4c-7nzbz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-7rlrw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e1a0c2-7cdd789b76-fl8sm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-bngsh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e1a0c2-6d4f598895-nxnwr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-e1a0c2-openshift-default-79f796bf87-jfnsq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

FailedGetScale

deployments.apps "e2e-shared-a-w4-7d99a4-openshift-default" not found

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-sqsp9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-7d99a4-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-shared-a-w4-7d99a4-openshift-default" not found

openshift-ingress

kubelet

e2e-shared-a-w4-7d99a4-openshift-default-5f5b5d6bd7-qld8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-dd81fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-dd81fd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555

SuccessfulCreate

Created pod: e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77bfb58f8c-28ksx
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77bfb58f8c from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-28ksx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-55vj6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-2kwq6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-7d99a4-cbf456bd-6fcrx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-7d99a4-788544f94c-rxtks

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

Unhealthy

Startup probe failed: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-852107-openshift-default-dbf795c59-5hznh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

ProbeError

Startup probe error: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-852107-7bd96c6c79-vgqg6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-852107-5d944d8796-w5d9p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3c874f-998846cc4-tbtz2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-3c874f-openshift-default-75f5654dfc-mx95p

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3c874f-57c4bc9655-pqvqq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8d80b1-7db8ddbb44-dbk8r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8d80b1-75767f48bc-ggqd4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-8d80b1-openshift-default-75f5688b99-mrcmd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-30e3dd-openshift-default-fff78f985-8nzfj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-30e3dd-7556fbf79-vl7g6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-30e3dd-58f9bf77fd-bcn44

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-72m8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-dd81fd-openshift-default-74ddf69555-w7skz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd81fd-84bc6865d8-4w7vh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd81fd-7c65d94f47-b52gk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-398c25-openshift-default-758b69476f-stp5q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-398c25-667cd69dc9-r8sxc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-398c25-654bf4cb5b-tm94s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-855e14-openshift-default-5c9588dcd9-pwxwv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-855e14-56ff45ddcd-gjvz2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-855e14-666bcc4f5-r6nz6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-2d5b09-openshift-default-6f4c95fc49-ssczm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-2d5b09-5f84fd87fd-bjq2h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-2d5b09-5c64bbc7f5-qzskz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-ait-6e1eb434-openshift-default-64b95b4ff7

SuccessfulCreate

Created pod: e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

openshift-ingress

deployment-controller

e2e-ait-6e1eb434-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6e1eb434-openshift-default-64b95b4ff7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-6e1eb434

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6e1eb434

openshift-ingress

multus

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

AddedInterface

Add eth0 [10.134.0.242/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6e1eb434: serviceaccount "payload-processing-e2e-ait-6e1eb434" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6e1eb434

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6e1eb434-c74ff4f98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6e1eb434-c74ff4f98

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6e1eb434-c74ff4f98

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6e1eb434-c74ff4f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6e1eb434: serviceaccount "payload-processing-e2e-ait-6e1eb434" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6e1eb434

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Created

Container created

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

ProbeError

Readiness probe error: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Started

Container started

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Unhealthy

Readiness probe failed: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

ProbeError

Startup probe error: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Unhealthy

Startup probe failed: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-6e1eb434-c74ff4f98-4xflz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6e1eb434-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6e1eb434-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6e1eb434-7b779bbccf-cxnq7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-6e1eb434-openshift-default-64b95b4ff7-gc4vj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

replicaset-controller

maas-controller-679796c8cb

SuccessfulDelete

Deleted pod: maas-controller-679796c8cb-4dk5t

opendatahub

kubelet

maas-controller-679796c8cb-4dk5t

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-679796c8cb

SuccessfulCreate

Created pod: maas-controller-679796c8cb-4z5zf

opendatahub

kubelet

maas-controller-679796c8cb-4z5zf

Started

Container started

opendatahub

kubelet

maas-controller-679796c8cb-4z5zf

Created

Container created

opendatahub

multus

maas-controller-679796c8cb-4z5zf

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-679796c8cb-4z5zf

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2"

opendatahub

kubelet

maas-controller-679796c8cb-4z5zf

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2" in 459ms (459ms including waiting). Image size: 200057368 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

AddedInterface

Add eth0 [10.134.0.249/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77bfb58f8c from 7 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77bfb58f8c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77bfb58f8c-bp56d

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

opendatahub

maas-controller-679796c8cb-4z5zf_f310fcc7-93fe-4ad4-ad08-0d9f1ece569c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-679796c8cb-4z5zf_f310fcc7-93fe-4ad4-ad08-0d9f1ece569c became leader
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

ProbeError

Startup probe error: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Unhealthy

Startup probe failed: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Unhealthy

Startup probe failed: Get "http://10.134.0.248:15021/healthz/ready": dial tcp 10.134.0.248:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

ProbeError

Startup probe error: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Unhealthy

Startup probe failed: Get "http://10.134.0.249:15021/healthz/ready": dial tcp 10.134.0.249:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

ProbeError

Startup probe error: Get "http://10.134.0.249:15021/healthz/ready": dial tcp 10.134.0.249:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

ProbeError

Startup probe error: Get "http://10.134.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Unhealthy

Startup probe failed: Get "http://10.134.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

ProbeError

Startup probe error: Get "http://10.134.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Unhealthy

Startup probe failed: Get "http://10.134.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

ProbeError

Startup probe error: Get "http://10.134.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Unhealthy

Startup probe failed: Get "http://10.134.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-679796c8cb from 1 to 0

opendatahub

kubelet

maas-controller-679796c8cb-4z5zf

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-679796c8cb

SuccessfulDelete

Deleted pod: maas-controller-679796c8cb-4z5zf
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-679796c8cb from 0 to 1

opendatahub

replicaset-controller

maas-controller-679796c8cb

SuccessfulCreate

Created pod: maas-controller-679796c8cb-rwz7m

opendatahub

multus

maas-controller-679796c8cb-rwz7m

AddedInterface

Add eth0 [10.134.0.250/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-679796c8cb-rwz7m

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2"

opendatahub

kubelet

maas-controller-679796c8cb-rwz7m

Created

Container created

opendatahub

kubelet

maas-controller-679796c8cb-rwz7m

Started

Container started

opendatahub

kubelet

maas-controller-679796c8cb-rwz7m

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:f061ac6a195efc2c67b84a20e7ede1a4938253be053b7103bb9f2acecc96adb2" in 413ms (413ms including waiting). Image size: 200057368 bytes.

opendatahub

maas-controller-679796c8cb-rwz7m_35648988-40b5-4180-b5d2-a313c300f778

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-679796c8cb-rwz7m_35648988-40b5-4180-b5d2-a313c300f778 became leader

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-pgmcn
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-pgmcn

Killing

Stopping container discovery

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.Secret llm/e2e-prio-pool-f2b786ee-kserve-self-signed-certs

llm

replicaset-controller

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c

SuccessfulCreate

Created pod: e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.Service llm/e2e-prio-pool-f2b786ee-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.Service llm/e2e-prio-pool-f2b786ee-epp-service

llm

replicaset-controller

e2e-prio-pool-f2b786ee-kserve-5458795b48

SuccessfulCreate

Created pod: e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.Deployment llm/e2e-prio-pool-f2b786ee-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-f2b786ee-epp-auth-rb

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.RoleBinding llm/e2e-prio-pool-f2b786ee-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.Role llm/e2e-prio-pool-f2b786ee-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.Deployment llm/e2e-prio-pool-f2b786ee-kserve

llm

deployment-controller

e2e-prio-pool-f2b786ee-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c from 0 to 1

llm

deployment-controller

e2e-prio-pool-f2b786ee-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-f2b786ee-kserve-5458795b48 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

Created v1.ServiceAccount llm/e2e-prio-pool-f2b786ee-epp-sa

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

AddedInterface

Add eth0 [10.133.1.91/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

Started

Container started

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

Created

Container created

llm

multus

e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

AddedInterface

Add eth0 [10.133.1.90/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-f2b786ee-kserve-route

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Started

Container started

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.744s (1.744s including waiting). Image size: 184206420 bytes.
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-f2b786ee-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Updated

Updated v1.Secret llm/e2e-prio-pool-f2b786ee-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-f2b786ee] is Ready

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-5458795b48-gv59h

Killing

Stopping container main

llm

LLMInferenceServiceController

e2e-prio-pool-f2b786ee

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-f2b786ee-epp-auth-rb

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Killing

Stopping container main

openshift-ingress

deployment-controller

e2e-worker-single-main-26a1d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5

SuccessfulCreate

Created pod: e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

openshift-ingress

multus

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-26a1d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-26a1d1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddf4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-26a1d1-5979c8ddf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-26a1d1: serviceaccount "payload-processing-e2e-worker-single-main-26a1d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddf4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-26a1d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-26a1d1-5979c8ddf4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-26a1d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b97dbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b97dbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b97dbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b97dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-26a1d1: serviceaccount "payload-processing-e2e-worker-single-main-26a1d1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

ProbeError

Readiness probe error: Get "http://10.134.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Unhealthy

Readiness probe failed: Get "http://10.134.0.251:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

ProbeError

Startup probe error: Get "http://10.134.0.251:15021/healthz/ready": dial tcp 10.134.0.251:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Unhealthy

Startup probe failed: Get "http://10.134.0.251:15021/healthz/ready": dial tcp 10.134.0.251:15021: connect: connection refused
(x5)

llm

kubelet

e2e-prio-pool-f2b786ee-kserve-router-scheduler-5cbcc9f68c-tblfb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-26a1d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-26a1d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-26a1d1-openshift-default-5d4454dcb5dhkx6

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.Secret llm/e2e-same-id-a-d820fa78-kserve-self-signed-certs

llm

kubelet

e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

Created

Container created

llm

kubelet

e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

replicaset-controller

e2e-same-id-a-d820fa78-kserve-5b8cfb96f

SuccessfulCreate

Created pod: e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

llm

deployment-controller

e2e-same-id-a-d820fa78-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-d820fa78-kserve-5b8cfb96f from 0 to 1

llm

kubelet

e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.Deployment llm/e2e-same-id-a-d820fa78-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.Service llm/e2e-same-id-a-d820fa78-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.HTTPRoute llm/e2e-same-id-a-d820fa78-kserve-route

llm

multus

e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

AddedInterface

Add eth0 [10.133.1.94/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.PodMonitor llm/e2e-same-id-a-d820fa78-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-d820fa78-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.DestinationRule llm/e2e-same-id-a-d820fa78-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Created

Created v1.PodMonitor llm/e2e-same-id-a-d820fa78-kserve-llmisvc-engine-default
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-26a1d1-5bc8b8srfx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-26a1d1-5979c8ddfbdcgc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

Updated

Updated v1.Secret llm/e2e-same-id-a-d820fa78-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-d820fa78] is Ready

llm

kubelet

e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

Created

Container created

llm

deployment-controller

e2e-same-id-b-d820fa78-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-d820fa78-kserve-66b466f7c from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.Service llm/e2e-same-id-b-d820fa78-kserve-workload-svc

llm

replicaset-controller

e2e-same-id-b-d820fa78-kserve-66b466f7c

SuccessfulCreate

Created pod: e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.HTTPRoute llm/e2e-same-id-b-d820fa78-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.DestinationRule llm/e2e-same-id-b-d820fa78-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.PodMonitor llm/e2e-same-id-b-d820fa78-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.PodMonitor llm/e2e-same-id-b-d820fa78-kserve-llmisvc-engine

llm

kubelet

e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.Deployment llm/e2e-same-id-b-d820fa78-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-d820fa78-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Created

Created v1.Secret llm/e2e-same-id-b-d820fa78-kserve-self-signed-certs

llm

multus

e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

ProbeError

Readiness probe error: Get "http://10.132.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-88m6n

Unhealthy

Readiness probe failed: Get "http://10.132.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

Unhealthy

Readiness probe failed: Get "http://10.132.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-lkn75

ProbeError

Readiness probe error: Get "http://10.132.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

Updated

Updated v1.Secret llm/e2e-same-id-b-d820fa78-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-d820fa78] is Ready
(x4)

llm

LLMInferenceServiceController

e2e-same-id-a-d820fa78

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-d820fa78 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-d820fa78; safe to ignore if traffic splitting is planned
(x6)

llm

LLMInferenceServiceController

e2e-same-id-b-d820fa78

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-d820fa78 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-d820fa78; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-d820fa78-kserve-5b8cfb96f-xtxrc

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-d820fa78-kserve-66b466f7c-95l4m

Killing

Stopping container main

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-778cf68b57 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-778cf68b57

SuccessfulCreate

Created pod: payload-pre-processing-778cf68b57-lmcwx

openshift-ingress

kubelet

payload-pre-processing-778cf68b57-lmcwx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-778cf68b57-lmcwx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-778cf68b57-lmcwx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-778cf68b57-lmcwx

AddedInterface

Add eth0 [10.133.1.98/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-n9x2v

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-n9x2v

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5797bb5d8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5797bb5d8c

SuccessfulCreate

Created pod: payload-processing-5797bb5d8c-cnmmz

openshift-ingress

multus

payload-processing-5797bb5d8c-cnmmz

AddedInterface

Add eth0 [10.133.1.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5797bb5d8c-cnmmz

Started

Container started

openshift-ingress

kubelet

payload-processing-5797bb5d8c-cnmmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-5797bb5d8c-cnmmz

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulDelete

Deleted pod: payload-processing-5f78687d5b-hgcd9

openshift-ingress

kubelet

payload-processing-5f78687d5b-hgcd9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-5f78687d5b from 1 to 0

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-58ddc49fd8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-cf6c69f79-89fc9

Started

Container started

openshift-ingress

multus

payload-pre-processing-cf6c69f79-89fc9

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-58ddc49fd8-p6cp9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-58ddc49fd8

SuccessfulCreate

Created pod: payload-processing-58ddc49fd8-p6cp9

openshift-ingress

kubelet

payload-processing-58ddc49fd8-p6cp9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-cf6c69f79-89fc9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-cf6c69f79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-cf6c69f79-89fc9

Created

Container created

openshift-ingress

kubelet

payload-processing-58ddc49fd8-p6cp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-58ddc49fd8-p6cp9

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-cf6c69f79

SuccessfulCreate

Created pod: payload-pre-processing-cf6c69f79-89fc9

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-5797bb5d8c from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-5797bb5d8c

SuccessfulDelete

Deleted pod: payload-processing-5797bb5d8c-cnmmz

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-778cf68b57 from 1 to 0

openshift-ingress

kubelet

payload-processing-5797bb5d8c-cnmmz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-778cf68b57-lmcwx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-778cf68b57

SuccessfulDelete

Deleted pod: payload-pre-processing-778cf68b57-lmcwx

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-758758b45d from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-758758b45d

FailedCreate

Error creating: pods "payload-processing-external-model-758758b45d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-v7xhl

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-758758b45d

SuccessfulCreate

Created pod: payload-processing-external-model-758758b45d-v7xhl

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-v7xhl

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-v7xhl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-758758b45d-v7xhl

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5797bb5d8c-cnmmz

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.1.99:50052" within 1s: context deadline exceeded

models-as-a-service

kubelet

payload-processing-external-model-758758b45d-v7xhl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fl76j

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

Unhealthy

Readiness probe failed: Get "http://10.133.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-fs5rj

ProbeError

Readiness probe error: Get "http://10.133.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-a9dee1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-a9dee1

openshift-ingress

multus

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

AddedInterface

Add eth0 [10.133.1.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9

SuccessfulCreate

Created pod: e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

openshift-ingress

deployment-controller

e2e-worker-single-main-a9dee1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-a9dee1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-a9dee1-864f456466 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-a9dee1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-a9dee1-96949f875 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-a9dee1-96949f875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-a9dee1-96949f875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-a9dee1-96949f875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-a9dee1: serviceaccount "payload-processing-e2e-worker-single-main-a9dee1" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

AddedInterface

Add eth0 [10.133.1.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-a9dee1-864f456466

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-a9dee1-864f456466

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-a9dee1-864f456466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-a9dee1: serviceaccount "payload-processing-e2e-worker-single-main-a9dee1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

AddedInterface

Add eth0 [10.133.1.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

Created

Container created

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Unhealthy

Readiness probe failed: Get "http://10.133.1.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

ProbeError

Readiness probe error: Get "http://10.133.1.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

ProbeError

Startup probe error: Get "http://10.133.1.115:15021/healthz/ready": dial tcp 10.133.1.115:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Unhealthy

Startup probe failed: Get "http://10.133.1.115:15021/healthz/ready": dial tcp 10.133.1.115:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-a9dee1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-a9dee1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-a9dee1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-a9dee1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-a9dee1-openshift-default-6d74455fb9qdtk2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-a9dee1-9694948z7h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-a9dee1-864f45646jxpxr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-txkl6

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-txkl6
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-8blbd
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-8blbd

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-8blbd

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-8blbd

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-8blbd

AddedInterface

Add eth0 [10.133.1.121/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-8blbd_b5734699-66a7-4779-a7a1-0270f1955007

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-8blbd_b5734699-66a7-4779-a7a1-0270f1955007 became leader
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

ProbeError

Readiness probe error: Get "http://10.134.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

Unhealthy

Readiness probe failed: Get "http://10.134.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-sq5vm

Unhealthy

Readiness probe failed: Get "http://10.134.0.248:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

ProbeError

Readiness probe error: Get "http://10.134.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-bp56d

Unhealthy

Readiness probe failed: Get "http://10.134.0.247:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-s6z4q

ProbeError

Readiness probe error: Get "http://10.134.0.249:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

Unhealthy

Readiness probe failed: Get "http://10.133.0.245:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-qzl6k

ProbeError

Readiness probe error: Get "http://10.133.0.245:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

Unhealthy

Readiness probe failed: Get "http://10.132.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-zkqzg

ProbeError

Readiness probe error: Get "http://10.132.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77bfb58f8c-vtlvz

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)