Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v to ip-10-0-137-156.ec2.internal

ai-tenants

e2e-api-a-fe085e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-fe085e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-54fd3c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-54fd3c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-b3e5f7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-b3e5f7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-cc2bcd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-cc2bcd: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-7a8bb6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-7a8bb6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-ac716b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-ac716b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-0f2e06

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-0f2e06: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-696c7a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-696c7a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-736f7c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-736f7c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-c712b1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-c712b1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-ea9556

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-ea9556: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-2365fa

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-2365fa: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-2dde84

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-2dde84: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-643355

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-643355: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-71a41c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-71a41c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-bb4907

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-bb4907: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-78ddbc

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-78ddbc: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-b72fa3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-b72fa3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-c4489d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-c4489d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-e271b1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-e271b1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-e6f4fe

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-e6f4fe: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-ba44ed

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-ba44ed: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-d042a8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-d042a8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-dfd6f0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-dfd6f0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-eb6010

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-eb6010: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-f765b8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-f765b8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-16e21e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-16e21e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-523de0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-523de0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-6cc3f7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-6cc3f7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-7e07c6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-7e07c6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-9f3716

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-9f3716: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-677726

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-677726: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-9d12c2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-9d12c2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-b2cc1f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-b2cc1f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-dc62c2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-dc62c2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-eb64ad

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-eb64ad: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-4b85d50c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-4b85d50c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-77dc65fb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-77dc65fb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-3624d8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-3624d8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-894bbb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-894bbb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-b7fde8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-b7fde8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-c7a27f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-c7a27f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-d60b29

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-d60b29: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-11b2e0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-11b2e0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-680c01

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-680c01: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-9ab4d2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-9ab4d2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-b2023a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-b2023a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-b2f76f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-b2f76f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-32ea65

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-32ea65: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-e4c131

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-e4c131: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-3d8293

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-3d8293: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-12df3c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-12df3c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-9877ce

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-9877ce: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-3575b9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-3575b9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-6929a4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-6929a4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-a44352

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-a44352: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-56bbb6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-56bbb6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-7f19e8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-7f19e8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-0fbc17

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-0fbc17: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-7e7a83

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-7e7a83: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-337764

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-337764: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-354660

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-354660: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-9db802

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-9db802: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-bjbfh

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-bjbfh to ip-10-0-135-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-8fmqz to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784 to ip-10-0-134-79.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-7xqxx to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx to ip-10-0-134-79.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-ztg66

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-ztg66 to ip-10-0-135-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-8qdvr to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-99lqk to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

Scheduled

Successfully assigned openshift-ingress/e2e-noten-7f38f1-openshift-default-59c89b95-f78n4 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl to ip-10-0-137-156.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-q7s4v

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-q7s4v to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-68twk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-68twk to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-66v28

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-66v28 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm to ip-10-0-134-79.ec2.internal

openshift-ingress

kube-auth-proxy-7c6946f9c7-sjbdk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c6946f9c7-sjbdk to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v to ip-10-0-137-156.ec2.internal

kuadrant-system

authorino-5698f55746-5klb6

Scheduled

Successfully assigned kuadrant-system/authorino-5698f55746-5klb6 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj to ip-10-0-137-156.ec2.internal

openshift-ingress

kube-auth-proxy-7c6946f9c7-gkrcg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c6946f9c7-gkrcg to ip-10-0-135-6.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-h54gn

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-h54gn to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv to ip-10-0-137-156.ec2.internal

ai-tenants

e2e-api-a-5a032f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-5a032f: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n to ip-10-0-134-79.ec2.internal

kuadrant-system

authorino-57f7f8659f-754zx

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-754zx to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj to ip-10-0-137-156.ec2.internal

kuadrant-system

authorino-6889cbd8c4-hrfwq

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-hrfwq to ip-10-0-134-79.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-z89sk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-z89sk to ip-10-0-137-156.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kmcv2 to ip-10-0-137-156.ec2.internal

kuadrant-system

authorino-6f6944bcdd-jjwgc

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-jjwgc to ip-10-0-134-79.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ftdzx to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77 to ip-10-0-137-156.ec2.internal

kuadrant-system

authorino-7564847bc7-zr86m

Scheduled

Successfully assigned kuadrant-system/authorino-7564847bc7-zr86m to ip-10-0-134-79.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-bdrxw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bdrxw to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh to ip-10-0-137-156.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-547hn

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-547hn to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8 to ip-10-0-137-156.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-nh2gw

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-nh2gw to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz to ip-10-0-135-6.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-xjq52

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-xjq52 to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl to ip-10-0-134-79.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-br6sk

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-br6sk to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4 to ip-10-0-134-79.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-w95pb

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-w95pb to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-55fbbbf9dc-pwdh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-pwdh9 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-6bd774d7c8-qp8jq

Scheduled

Successfully assigned openshift-ingress/payload-processing-6bd774d7c8-qp8jq to ip-10-0-137-156.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-nx647

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-nx647 to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-6d9486d65f-f62bl

Scheduled

Successfully assigned openshift-ingress/payload-processing-6d9486d65f-f62bl to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ait-466229b7-757d899967-mqk4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-466229b7-757d899967-mqk4x to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf to ip-10-0-137-156.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-d5hvn

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-d5hvn to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt to ip-10-0-135-6.ec2.internal

models-as-a-service

payload-processing-external-model-66bbdd4b74-qhldk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66bbdd4b74-qhldk to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x to ip-10-0-134-79.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-cvhcv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-cvhcv to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-b652g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-b652g to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d47676-668589f87f-kz8h4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d47676-668589f87f-kz8h4 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8 to ip-10-0-134-79.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-pvwn5

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-pvwn5 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4b85d50c-openshift-default-558d957877-z2knj to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6 to ip-10-0-137-156.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk to ip-10-0-137-156.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-2srl5

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-2srl5 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

Scheduled

Successfully assigned openshift-ingress/e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

Scheduled

Successfully assigned openshift-ingress/e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl to ip-10-0-137-156.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-96rr4

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-96rr4 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m to ip-10-0-137-156.ec2.internal

ai-tenants

e2e-api-a-d47676

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-d47676: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-d9669 to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckx7l to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht to ip-10-0-134-79.ec2.internal

llm

e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

Scheduled

Successfully assigned llm/e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-hm547

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hm547 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8 to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-6859d58686-kckgm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6859d58686-kckgm to ip-10-0-137-156.ec2.internal

llm

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Scheduled

Successfully assigned llm/e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd to ip-10-0-134-79.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-cljsc to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz to ip-10-0-135-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-cf7zm to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s to ip-10-0-134-79.ec2.internal

llm

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

Scheduled

Successfully assigned llm/e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-api-a-d47676-openshift-default-6df488c785-gm487

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d47676-openshift-default-6df488c785-gm487 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6 to ip-10-0-137-156.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-59bgd

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-59bgd to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Scheduled

Successfully assigned openshift-ingress/e2e-ait-935d4e21-openshift-default-555f96899-bfw85 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-txc78 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25 to ip-10-0-134-79.ec2.internal

llm

e2e-same-id-a-e7cd98d7

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-e7cd98d7

llm

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

Scheduled

Successfully assigned llm/e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz to ip-10-0-137-156.ec2.internal

openshift-jobset-operator

jobset-controller-manager-654dd4f8f5-7d2pz

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-654dd4f8f5-7d2pz to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47 to ip-10-0-135-6.ec2.internal

models-as-a-service

payload-processing-external-model-66bbdd4b74-mfg7f

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66bbdd4b74-mfg7f to ip-10-0-134-79.ec2.internal

models-as-a-service

payload-processing-external-model-744487595b-p774w

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-744487595b-p774w to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7 to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-htjfk to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7 to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-jl6c9 to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-jvnf9 to ip-10-0-134-79.ec2.internal

llm

e2e-same-id-b-e7cd98d7

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-e7cd98d7

llm

e2e-same-id-b-e7cd98d7

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-glvhv

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-glvhv to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Scheduled

Successfully assigned openshift-ingress/e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f to ip-10-0-137-156.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb to ip-10-0-134-79.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-756f6c987b-mld7r

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-756f6c987b-mld7r to ip-10-0-134-79.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-756f6c987b-9lkb5 to ip-10-0-137-156.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-756f6c987b-764mm

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-756f6c987b-764mm to ip-10-0-135-6.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-fj5gs to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f to ip-10-0-134-79.ec2.internal

opendatahub

test-curl-7361-f96a04

Scheduled

Successfully assigned opendatahub/test-curl-7361-f96a04 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc to ip-10-0-137-156.ec2.internal

opendatahub

test-curl-7361-901598

Scheduled

Successfully assigned opendatahub/test-curl-7361-901598 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-688jz to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n to ip-10-0-137-156.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm to ip-10-0-134-79.ec2.internal

opendatahub

test-curl-7361-8b5248

Scheduled

Successfully assigned opendatahub/test-curl-7361-8b5248 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-337764-openshift-default-555d885b9-626zl to ip-10-0-134-79.ec2.internal

opendatahub

test-curl-7361-7d48e3

Scheduled

Successfully assigned opendatahub/test-curl-7361-7d48e3 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd to ip-10-0-137-156.ec2.internal

opendatahub

test-curl-7361-6fc1fa

Scheduled

Successfully assigned opendatahub/test-curl-7361-6fc1fa to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-6dzmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-6dzmc to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh to ip-10-0-134-79.ec2.internal

opendatahub

test-curl-7361-22fe8c

Scheduled

Successfully assigned opendatahub/test-curl-7361-22fe8c to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-6fcc67b9b4-qld9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6fcc67b9b4-qld9t to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-pre-processing-676c644999-plhvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-676c644999-plhvd to ip-10-0-137-156.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-xbgtq

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-xbgtq to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt to ip-10-0-137-156.ec2.internal

opendatahub

test-curl-7361-149f84

Scheduled

Successfully assigned opendatahub/test-curl-7361-149f84 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr to ip-10-0-135-6.ec2.internal

opendatahub

test-curl-7361-1277d5

Scheduled

Successfully assigned opendatahub/test-curl-7361-1277d5 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92 to ip-10-0-135-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-jxxsm to ip-10-0-134-79.ec2.internal

opendatahub

test-curl-7355-dac468

Scheduled

Successfully assigned opendatahub/test-curl-7355-dac468 to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-665db6c6c-slv9b

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-665db6c6c-slv9b to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb to ip-10-0-137-156.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm to ip-10-0-137-156.ec2.internal

opendatahub

test-curl-7355-8fa938

Scheduled

Successfully assigned opendatahub/test-curl-7355-8fa938 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp to ip-10-0-134-79.ec2.internal

opendatahub

test-curl-7352-76e02c

Scheduled

Successfully assigned opendatahub/test-curl-7352-76e02c to ip-10-0-135-6.ec2.internal

opendatahub

odh-model-controller-769875db56-rcnpx

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-rcnpx to ip-10-0-134-79.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-pq62z

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-pq62z to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65 to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd to ip-10-0-137-156.ec2.internal

opendatahub

maas-controller-84d6885777-t98mz

Scheduled

Successfully assigned opendatahub/maas-controller-84d6885777-t98mz to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t to ip-10-0-137-156.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl to ip-10-0-134-79.ec2.internal

opendatahub

maas-controller-5f6b5c786d-z74vw

Scheduled

Successfully assigned opendatahub/maas-controller-5f6b5c786d-z74vw to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t to ip-10-0-137-156.ec2.internal

opendatahub

maas-controller-5f6b5c786d-jb7pn

Scheduled

Successfully assigned opendatahub/maas-controller-5f6b5c786d-jb7pn to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx to ip-10-0-137-156.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst to ip-10-0-137-156.ec2.internal

opendatahub

maas-controller-5f6b5c786d-hmrvb

Scheduled

Successfully assigned opendatahub/maas-controller-5f6b5c786d-hmrvb to ip-10-0-137-156.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-vknrx

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-vknrx to ip-10-0-135-6.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-kqv85

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-kqv85 to ip-10-0-135-6.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-kv7wp

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-kv7wp to ip-10-0-135-6.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-g8nbx

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-g8nbx to ip-10-0-135-6.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-p2fzb

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-p2fzb to ip-10-0-137-156.ec2.internal

opendatahub

ai-gateway-controller-785d49bf89-46p4s

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-785d49bf89-46p4s to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2 to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-5cf4bb9494-z68c2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5cf4bb9494-z68c2 to ip-10-0-134-79.ec2.internal

models-as-a-service

payload-processing-external-model-5649fd4f9b-jj5dj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5649fd4f9b-jj5dj to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h to ip-10-0-134-79.ec2.internal

openshift-ingress

router-default-6dd94bff97-89klj

Scheduled

Successfully assigned openshift-ingress/router-default-6dd94bff97-89klj to ip-10-0-134-79.ec2.internal

openshift-ingress

router-default-6dd94bff97-89klj

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-6dd94bff97-89klj

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9 to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-58ddf7f69-plx99

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-58ddf7f69-plx99 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j to ip-10-0-135-6.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-d2sj7 to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4 to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-5b845f4bcb-qx9t6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5b845f4bcb-qx9t6 to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-wgbb7 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-r2tbm to ip-10-0-135-6.ec2.internal

openshift-ingress

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8 to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-f6dgq to ip-10-0-135-6.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-5b8468948b-9l7j4

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5b8468948b-9l7j4 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-gppb5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-gppb5 to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-gsh6q to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-5cf4bb9494-7n5wc

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5cf4bb9494-7n5wc to ip-10-0-134-79.ec2.internal

openshift-ingress

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7 to ip-10-0-137-156.ec2.internal

models-as-a-service

payload-processing-external-model-5bc4454848-958cf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bc4454848-958cf to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-pnq5t to ip-10-0-134-79.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-n97lr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-n97lr to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-m4rk6 to ip-10-0-134-79.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-lxxrh to ip-10-0-135-6.ec2.internal

models-as-a-service

payload-processing-external-model-5bc4454848-fs5kr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bc4454848-fs5kr to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6 to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hf7z5 to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd to ip-10-0-134-79.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hkc5n to ip-10-0-135-6.ec2.internal

models-as-a-service

payload-processing-external-model-7898f6c747-89x6j

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7898f6c747-89x6j to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b to ip-10-0-137-156.ec2.internal

openshift-ingress

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l to ip-10-0-134-79.ec2.internal

models-as-a-service

payload-processing-external-model-5bcd7997-78tsw

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-78tsw to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d to ip-10-0-137-156.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7f5667f86c-k9x79

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-k9x79 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5 to ip-10-0-134-79.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf to ip-10-0-137-156.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v to ip-10-0-137-156.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6dd94bff97 from 0 to 1

openshift-ingress

replicaset-controller

router-default-6dd94bff97

FailedCreate

Error creating: pods "router-default-6dd94bff97-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-6dd94bff97

SuccessfulCreate

Created pod: router-default-6dd94bff97-89klj

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-6dd94bff97-89klj

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

Created

Container created

openshift-ingress

kubelet

router-default-6dd94bff97-89klj

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-cvhcv

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-cvhcv

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.539s (2.539s including waiting). Image size: 185476477 bytes.

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-65dccbd94c

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-pnq5t
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-65dccbd94c from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.969s (7.969s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-65dccbd94c-mjtj2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.9s (7.9s including waiting). Image size: 183555333 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-59bgd

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59bgd

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-59bgd

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59bgd

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59bgd

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-59bgd

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.501s (2.501s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-59bgd_ad069e3b-4a2a-4eeb-8b88-d27ed59fc2ef became leader
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-q7s4v

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-q7s4v

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q7s4v

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q7s4v

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q7s4v

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q7s4v

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.404s (2.404s including waiting). Image size: 309650901 bytes.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-pvwn5

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-pvwn5

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pvwn5

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pvwn5

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-ztg66

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-ztg66

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-ztg66

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pvwn5

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pvwn5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.51s (2.51s including waiting). Image size: 177967631 bytes.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-ztg66

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-ztg66

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

limitador-operator-controller-manager-5778bb4449-pvwn5_2c7e501b-b8a4-4613-a89f-181f2f7a37b2

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-pvwn5_2c7e501b-b8a4-4613-a89f-181f2f7a37b2 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-547hn

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

authorino-operator-7b7bb4bc77-547hn

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-547hn

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-547hn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.688s (1.688s including waiting). Image size: 167738465 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-bjbfh

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-bjbfh

cert-manager

kubelet

cert-manager-597b95cb84-bjbfh

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-bjbfh

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-547hn

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-547hn

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-bjbfh

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

authorino-operator-7b7bb4bc77-547hn_66702270-b99c-42bb-a2af-8df5a3b70caa

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-547hn_66702270-b99c-42bb-a2af-8df5a3b70caa became leader

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-nh2gw

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-nh2gw

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-nh2gw

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-nh2gw

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-nh2gw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.981s (1.981s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-nh2gw

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

dns-operator-controller-manager-8557cbdb84-nh2gw_cdd55ea6-098b-47ea-ab7e-11a8109b67f3

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-nh2gw_cdd55ea6-098b-47ea-ab7e-11a8109b67f3 became leader

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-756f6c987b from 0 to 3

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-756f6c987b

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-756f6c987b-mld7r

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-756f6c987b

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-756f6c987b-764mm

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-756f6c987b

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-756f6c987b-9lkb5

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-756f6c987b-mld7r

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-756f6c987b-9lkb5

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-756f6c987b-764mm

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.94s (2.94s including waiting). Image size: 273709574 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-br6sk

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Started

Container started

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-br6sk

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.924s (2.924s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-br6sk

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.923s (2.923s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 276ms (276ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-756f6c987b-764mm_ecf8a11f-301a-4e8f-83db-fc06bdfc0869

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-756f6c987b-764mm_ecf8a11f-301a-4e8f-83db-fc06bdfc0869 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-mld7r

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-764mm

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 272ms (272ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 320ms (320ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-756f6c987b-9lkb5

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-br6sk_36396c12-b306-407a-9fb5-ad3be961e2cf

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-br6sk_36396c12-b306-407a-9fb5-ad3be961e2cf became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-br6sk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.881s (3.881s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-br6sk

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-br6sk

Created

Container created

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-xjq52

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-xjq52

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xjq52

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xjq52

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xjq52

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.549s (4.549s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xjq52

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7cfc97f8f7 from 0 to 1

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7c6946f9c7 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6946f9c7

SuccessfulCreate

Created pod: kube-auth-proxy-7c6946f9c7-gkrcg

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6946f9c7

SuccessfulCreate

Created pod: kube-auth-proxy-7c6946f9c7-sjbdk

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-sjbdk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-7c6946f9c7-sjbdk

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7cfc97f8f7

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-z7f59"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-gkrcg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-7c6946f9c7-gkrcg

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb

Created

Container created

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-9bbnd"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7cfc97f8f78brcb

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-nx647

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-d5hvn

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-754zx

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-nx647

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-74dfcfb894-nx647

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-sjbdk

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-654dd4f8f5-7d2pz

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-gkrcg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.445s (2.445s including waiting). Image size: 188904677 bytes.

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-654dd4f8f5

SuccessfulCreate

Created pod: jobset-controller-manager-654dd4f8f5-7d2pz

kuadrant-system

multus

limitador-limitador-7c9b87d574-d5hvn

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-gkrcg

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-gkrcg

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d5hvn

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-sjbdk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.394s (2.394s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c6946f9c7-sjbdk

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-h54gn

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-654dd4f8f5 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-754zx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-jobset-operator

multus

jobset-controller-manager-654dd4f8f5-7d2pz

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

multus

authorino-57f7f8659f-754zx

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

multus

authorino-56c6c9ddd5-h54gn

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-nx647

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-nx647

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-nx647

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.837s (2.837s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-h54gn

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d5hvn

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d5hvn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.279s (2.279s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d5hvn

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-754zx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.675s (3.675s including waiting). Image size: 204096810 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-654dd4f8f5-7d2pz

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-654dd4f8f5-7d2pz

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-754zx

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-754zx

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-654dd4f8f5-7d2pz

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.24s (3.24s including waiting). Image size: 182184678 bytes.

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-kv7wp

kuadrant-system

kubelet

authorino-56c6c9ddd5-h54gn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.341s (3.341s including waiting). Image size: 204096810 bytes.

openshift-jobset-operator

jobset-controller-manager-654dd4f8f5-7d2pz_fea1477c-84ce-4d6f-baf2-4d13c48dbb57

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-654dd4f8f5-7d2pz_fea1477c-84ce-4d6f-baf2-4d13c48dbb57 became leader

kuadrant-system

kubelet

authorino-56c6c9ddd5-h54gn

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-h54gn

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-kv7wp

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-kv7wp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-754zx

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-kv7wp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.6s (1.6s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-kv7wp

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-kv7wp

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-754zx

Killing

Stopping container authorino

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-nx647

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-nx647

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-kv7wp_4d049b05-0fc0-4d2b-ba0e-d0b55cb10133

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-kv7wp_4d049b05-0fc0-4d2b-ba0e-d0b55cb10133 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-84d6885777 from 0 to 1

opendatahub

replicaset-controller

maas-controller-5f6b5c786d

SuccessfulCreate

Created pod: maas-controller-5f6b5c786d-jb7pn

opendatahub

kubelet

maas-controller-84d6885777-t98mz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "maas-controller-metrics-tls" not found

opendatahub

replicaset-controller

maas-controller-84d6885777

SuccessfulCreate

Created pod: maas-controller-84d6885777-t98mz

opendatahub

multus

maas-controller-5f6b5c786d-jb7pn

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-84d6885777-t98mz

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a"

opendatahub

kubelet

maas-controller-5f6b5c786d-jb7pn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a"

opendatahub

multus

maas-controller-84d6885777-t98mz

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5f6b5c786d-jb7pn

Started

Container started

opendatahub

maas-controller-5f6b5c786d-jb7pn_d57c91e5-f3af-4afc-97de-cf759cec0f0f

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5f6b5c786d-jb7pn_d57c91e5-f3af-4afc-97de-cf759cec0f0f became leader

opendatahub

kubelet

maas-controller-5f6b5c786d-jb7pn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a" in 2.737s (2.737s including waiting). Image size: 200096244 bytes.

opendatahub

kubelet

maas-controller-5f6b5c786d-jb7pn

Created

Container created

opendatahub

kubelet

maas-controller-84d6885777-t98mz

Started

Container started

opendatahub

kubelet

maas-controller-84d6885777-t98mz

Created

Container created

opendatahub

kubelet

maas-controller-84d6885777-t98mz

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a" in 2.771s (2.771s including waiting). Image size: 200096244 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-84d6885777 from 1 to 0

opendatahub

kubelet

maas-controller-84d6885777-t98mz

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-84d6885777

SuccessfulDelete

Deleted pod: maas-controller-84d6885777-t98mz

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.739s (11.739s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5gs

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-z89sk

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z89sk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z89sk

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z89sk

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-z89sk

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-rcnpx

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-vknrx

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vknrx

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-vknrx

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

multus

model-serving-api-75bd89fdfc-pq62z

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

multus

odh-model-controller-769875db56-rcnpx

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-g8nbx

opendatahub

kubelet

kserve-controller-manager-776cc66d47-g8nbx

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

kserve-controller-manager-776cc66d47-g8nbx

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-pq62z

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-pq62z

opendatahub

kubelet

odh-model-controller-769875db56-rcnpx

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cvhcv

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-cvhcv

opendatahub

kubelet

model-serving-api-75bd89fdfc-pq62z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.956s (1.956s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-rcnpx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.765s (2.765s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-pq62z

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vknrx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.344s (2.344s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vknrx

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vknrx

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-g8nbx

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.467s (2.467s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-g8nbx

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-g8nbx

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-pq62z

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-rcnpx

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-rcnpx

Created

Container created

opendatahub

odh-model-controller-769875db56-rcnpx_1a7d1285-8b44-4d98-a26b-4dc5951d27e5

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-rcnpx_1a7d1285-8b44-4d98-a26b-4dc5951d27e5 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-vknrx_b66e4e72-45cb-4304-ac0d-f0314be22d79

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-vknrx_b66e4e72-45cb-4304-ac0d-f0314be22d79 became leader

opendatahub

kserve-controller-manager-776cc66d47-g8nbx_5ec8c09a-aaac-42df-9a76-73a492b9ddb0

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-g8nbx_5ec8c09a-aaac-42df-9a76-73a492b9ddb0 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-jjwgc

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-hrfwq

kuadrant-system

replicaset-controller

authorino-7564847bc7

SuccessfulCreate

Created pod: authorino-7564847bc7-zr86m

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7564847bc7 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-jjwgc

kuadrant-system

multus

authorino-7564847bc7-zr86m

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-hrfwq

kuadrant-system

kubelet

authorino-7564847bc7-zr86m

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

kubelet

authorino-7564847bc7-zr86m

Created

Container created

kuadrant-system

kubelet

authorino-7564847bc7-zr86m

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 638ms (638ms including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-h54gn

kuadrant-system

kubelet

authorino-7564847bc7-zr86m

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-56c6c9ddd5-h54gn

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused
(x7)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kqv85

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-kqv85

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-kqv85

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kqv85

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 337ms (337ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kqv85

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-kqv85

Created

Container created

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-vknrx

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-vknrx

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p2fzb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-p2fzb

opendatahub

multus

ai-gateway-controller-7d85675f98-p2fzb

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p2fzb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.327s (2.327s including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p2fzb

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p2fzb

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-p2fzb_d5f08430-f73c-434c-b23f-b45ec3cdcaef

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-p2fzb_d5f08430-f73c-434c-b23f-b45ec3cdcaef became leader

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-6dzmc

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-pwdh9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-6dzmc

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-55fbbbf9dc-pwdh9

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6dzmc

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-pwdh9

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6dzmc

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-pwdh9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6dzmc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.291s (2.291s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6dzmc

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-pwdh9

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-pwdh9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.319s (2.319s including waiting). Image size: 125353963 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-785d49bf89

SuccessfulCreate

Created pod: ai-gateway-controller-785d49bf89-46p4s

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-785d49bf89 from 0 to 1

opendatahub

llmisvc-controller-manager-6466c554d8-kqv85_c4721eae-c652-4861-ba61-0a8322916ee6

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-kqv85_c4721eae-c652-4861-ba61-0a8322916ee6 became leader

opendatahub

kubelet

ai-gateway-controller-785d49bf89-46p4s

Started

Container started

opendatahub

kubelet

ai-gateway-controller-785d49bf89-46p4s

Created

Container created

opendatahub

kubelet

ai-gateway-controller-785d49bf89-46p4s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 510ms (510ms including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-785d49bf89-46p4s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-785d49bf89-46p4s

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p2fzb

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-p2fzb

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-c56z2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.176s (1.176s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-2srl5

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-2srl5

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2srl5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2srl5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.267s (1.267s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2srl5

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2srl5

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

opendatahub

ai-gateway-controller-785d49bf89-46p4s_a2d847cf-19f7-4755-b61f-248cbc1a467a

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-785d49bf89-46p4s_a2d847cf-19f7-4755-b61f-248cbc1a467a became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-96rr4

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-96rr4

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-96rr4

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-96rr4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 223ms (223ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-96rr4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-96rr4

Started

Container started

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-glvhv

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-glvhv

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-glvhv

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-glvhv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 179ms (179ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-glvhv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-glvhv

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 171ms (171ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b84f2m6

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-xbgtq

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

multus

echo-simulator-kserve-64b6f8f96c-xbgtq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xbgtq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xbgtq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.381s (1.381s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xbgtq

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xbgtq

Started

Container started

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-s2vrv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 229ms (229ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 204ms (204ms including waiting). Image size: 98346788 bytes.

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-cljsc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-k9x79

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-hm547

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-cljsc

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-hm547

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-k9x79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-k9x79

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-k9x79

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-k9x79

Created

Container created

kuadrant-system

replicaset-controller

authorino-5698f55746

SuccessfulCreate

Created pod: authorino-5698f55746-5klb6

kuadrant-system

kubelet

authorino-5698f55746-5klb6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-5698f55746-5klb6

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5698f55746-5klb6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 937ms (937ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5698f55746-5klb6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.805s (2.805s including waiting). Image size: 183555333 bytes.

kuadrant-system

kubelet

authorino-5698f55746-5klb6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.844s (2.844s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Started

Container started

kuadrant-system

kubelet

authorino-7564847bc7-zr86m

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-7564847bc7

SuccessfulDelete

Deleted pod: authorino-7564847bc7-zr86m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Created

Container created
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-7564847bc7 from 1 to 0
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-k9x79

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-k9x79

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-8fmqz

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-b652g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-d2sj7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 4 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-b652g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-b652g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-b652g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-b652g

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-b652g

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-b652g

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-935d4e21-openshift-default-555f96899

SuccessfulCreate

Created pod: e2e-ait-935d4e21-openshift-default-555f96899-bfw85

openshift-ingress

gateway_labeler_controller

e2e-migrate-b9780053-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b9780053-gw

openshift-ingress

deployment-controller

e2e-migrate-b9780053-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b9780053-gw-openshift-default-7c556db489 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-be1fb7c9-openshift-default-7f46bd7587

SuccessfulCreate

Created pod: e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

openshift-ingress

deployment-controller

e2e-ait-935d4e21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-935d4e21-openshift-default-555f96899 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-b9780053-gw-openshift-default-7c556db489

SuccessfulCreate

Created pod: e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

openshift-ingress

gateway_labeler_controller

e2e-ait-935d4e21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-935d4e21

openshift-ingress

deployment-controller

e2e-ait-be1fb7c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-be1fb7c9-openshift-default-7f46bd7587 from 0 to 1

openshift-ingress

multus

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-be1fb7c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-be1fb7c9

openshift-ingress

deployment-controller

e2e-ait-8ff8e809-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8ff8e809-openshift-default-6b877dd89c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-8ff8e809

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8ff8e809

openshift-ingress

multus

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-8ff8e809-openshift-default-6b877dd89c

SuccessfulCreate

Created pod: e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

openshift-ingress

multus

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b9780053

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b9780053-68d6b99f49 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b9780053

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b9780053-68d6b99f49

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b9780053-68d6b99f49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b9780053: serviceaccount "payload-processing-e2e-migrate-b9780053" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b9780053: serviceaccount "payload-processing-e2e-migrate-b9780053" not found

openshift-ingress

multus

payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b9780053-68d6b99f49

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-935d4e21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-935d4e21-d9d897fb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-935d4e21-d9d897fb9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-935d4e21-d9d897fb9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-935d4e21-d9d897fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-935d4e21: serviceaccount "payload-processing-e2e-ait-935d4e21" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-935d4e21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-935d4e21-65dbf594cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-935d4e21: serviceaccount "payload-processing-e2e-ait-935d4e21" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-be1fb7c9: serviceaccount "payload-processing-e2e-ait-be1fb7c9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-be1fb7c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-be1fb7c9-868cbddff7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-be1fb7c9-868cbddff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-be1fb7c9: serviceaccount "payload-processing-e2e-ait-be1fb7c9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-be1fb7c9-868cbddff7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

openshift-ingress

deployment-controller

payload-processing-e2e-ait-be1fb7c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-be1fb7c9-868cbddff7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-8c43c08e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8c43c08e-openshift-default-6cd84689b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-8c43c08e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8c43c08e

openshift-ingress

replicaset-controller

e2e-derive-8c43c08e-openshift-default-6cd84689b5

SuccessfulCreate

Created pod: e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

openshift-ingress

multus

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.668s (2.668s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.978s (1.979s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8ff8e809

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8ff8e809-f85d4b49f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ff8e809-f85d4b49f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8ff8e809-f85d4b49f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8ff8e809-f85d4b49f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ff8e809: serviceaccount "payload-processing-e2e-ait-8ff8e809" not found

openshift-ingress

multus

payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.283s (2.283s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8ff8e809: serviceaccount "payload-processing-e2e-ait-8ff8e809" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8ff8e809

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8ff8e809-cb5877c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8c43c08e: serviceaccount "payload-processing-e2e-derive-8c43c08e" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8c43c08e-56884bd7b7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8c43c08e-56884bd7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8c43c08e: serviceaccount "payload-processing-e2e-derive-8c43c08e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8c43c08e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8c43c08e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8c43c08e-56884bd7b7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8c43c08e-56884bd7b7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

openshift-ingress

kubelet

payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

Started

Container started

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b9780053-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b9780053-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935d4e21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935d4e21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-8ff8e809-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-8ff8e809-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:57430->10.132.0.54:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:57430->10.132.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-b9780053-68d6b99f49-zqg9t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b9780053-755fd4dd7f-2vdwl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8ff8e809-cb5877c5-r2twm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8ff8e809-f85d4b49f-rt2lg

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c43c08e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c43c08e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-935d4e21-d9d897fb9-t559k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-935d4e21-65dbf594cf-z8qnz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-354660

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-354660

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-b9780053-gw-openshift-default-7c556db489-fkpw2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-0fbc17

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-0fbc17

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935d4e21-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-935d4e21-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-8ff8e809-openshift-default-6b877dd89c-ln574

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-be1fb7c9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-be1fb7c9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-be1fb7c9-7f5ccb7df5-j4ns5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-be1fb7c9-868cbddff7-qq8s7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8c43c08e-cd5dbb799-2n8mx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8c43c08e-56884bd7b7-v9m2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-337764

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-337764

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-354660-59855fc979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

openshift-ingress

kubelet

e2e-ait-be1fb7c9-openshift-default-7f46bd7587-dfzl5

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-354660-58c847bbf7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-354660-58c847bbf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-354660: serviceaccount "payload-processing-e2e-worker-w3-354660" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-354660-58c847bbf7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-354660

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-354660-58c847bbf7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-354660

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-354660-59855fc979 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-354660-59855fc979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-354660-59855fc979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-354660: serviceaccount "payload-processing-e2e-worker-w3-354660" not found

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-935d4e21-openshift-default-555f96899-bfw85

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-9db802

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-9db802

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-0fbc17-849c8fb697

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-0fbc17-849c8fb697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-0fbc17: serviceaccount "payload-processing-e2e-worker-w0-0fbc17" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-0fbc17

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-0fbc17

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-0fbc17-849c8fb697 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-0fbc17: serviceaccount "payload-processing-e2e-worker-w0-0fbc17" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-0fbc17-849c8fb697

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-337764

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-337764-79b874659f from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c43c08e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-337764: serviceaccount "payload-processing-e2e-worker-w2-337764" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-8c43c08e-openshift-default-6cd84689b5-7cgsw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-8c43c08e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-337764-79b874659f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-337764-79b874659f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-337764: serviceaccount "payload-processing-e2e-worker-w2-337764" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-337764-79b874659f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-337764

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-7e7a83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-7e7a83

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-9db802

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-9db802-544bb54dbf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-9db802-544bb54dbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-9db802-544bb54dbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-9db802: serviceaccount "payload-processing-e2e-worker-w4-9db802" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-9db802

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-9db802-744b4d58c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-9db802: serviceaccount "payload-processing-e2e-worker-w4-9db802" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-9db802-544bb54dbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

openshift-ingress

multus

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-7e7a83: serviceaccount "payload-processing-e2e-worker-w1-7e7a83" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-7e7a83: serviceaccount "payload-processing-e2e-worker-w1-7e7a83" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-7e7a83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-7e7a83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-665db6c6c from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-665db6c6c-slv9b

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-665db6c6c

SuccessfulCreate

Created pod: payload-processing-external-model-665db6c6c-slv9b

models-as-a-service

multus

payload-processing-external-model-665db6c6c-slv9b

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-665db6c6c-slv9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-665db6c6c-slv9b

Started

Container started
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-665db6c6c

FailedCreate

Error creating: pods "payload-processing-external-model-665db6c6c-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-99lqk

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-99lqk

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-7xqxx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 7 to 9

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7898f6c747 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7898f6c747

SuccessfulCreate

Created pod: payload-processing-external-model-7898f6c747-89x6j

models-as-a-service

kubelet

payload-processing-external-model-7898f6c747-89x6j

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-7898f6c747-89x6j

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7898f6c747-89x6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7898f6c747-89x6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Created

Container created

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 1 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-7f5667f86c-68twk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-68twk

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-626zl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes
(x6)

models-as-a-service

kubelet

payload-processing-external-model-7898f6c747-89x6j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7898f6c747 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7898f6c747

SuccessfulDelete

Deleted pod: payload-processing-external-model-7898f6c747-89x6j

models-as-a-service

replicaset-controller

payload-processing-external-model-66bbdd4b74

SuccessfulCreate

Created pod: payload-processing-external-model-66bbdd4b74-qhldk

models-as-a-service

kubelet

payload-processing-external-model-7898f6c747-89x6j

Killing

Stopping container payload-processing

models-as-a-service

multus

payload-processing-external-model-66bbdd4b74-qhldk

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-qhldk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-qhldk

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-qhldk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

models-as-a-service

kubelet

payload-processing-external-model-665db6c6c-slv9b

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-665db6c6c from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-665db6c6c

SuccessfulDelete

Deleted pod: payload-processing-external-model-665db6c6c-slv9b

models-as-a-service

replicaset-controller

payload-processing-external-model-6859d58686

SuccessfulCreate

Created pod: payload-processing-external-model-6859d58686-kckgm

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6859d58686 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-6859d58686-kckgm

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6859d58686-kckgm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6859d58686-kckgm

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6859d58686-kckgm

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

Created

Container created

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-66bbdd4b74 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-66bbdd4b74

SuccessfulDelete

Deleted pod: payload-processing-external-model-66bbdd4b74-qhldk

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-qhldk

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 6 to 8

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

Started

Container started

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

Started

Container started

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Started

Container started

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

Created

Container created

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-txc78

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-688jz

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

replicaset-controller

payload-processing-external-model-66bbdd4b74

SuccessfulCreate

Created pod: payload-processing-external-model-66bbdd4b74-mfg7f
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-66bbdd4b74 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-mfg7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-66bbdd4b74-mfg7f

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-mfg7f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-mfg7f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Started

Container started

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-66bbdd4b74-mfg7f

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6859d58686-kckgm

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Created

Container created

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x9)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

gateway_labeler_controller

e2e-mt-77dc65fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-77dc65fb

openshift-ingress

replicaset-controller

e2e-mt-77dc65fb-openshift-default-b6b44599c

SuccessfulCreate

Created pod: e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

openshift-ingress

deployment-controller

e2e-mt-77dc65fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-77dc65fb-openshift-default-b6b44599c from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Unhealthy

Readiness probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

ProbeError

Readiness probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Unhealthy

Readiness probe failed: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

ProbeError

Readiness probe error: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

Created

Container created

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

Started

Container started

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-77dc65fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-77dc65fb-784fcb597f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-77dc65fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-77dc65fb-785b45cf9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-77dc65fb-785b45cf9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-77dc65fb-785b45cf9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-77dc65fb-785b45cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-77dc65fb: serviceaccount "payload-processing-e2e-mt-77dc65fb" not found

openshift-ingress

multus

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-77dc65fb: serviceaccount "payload-processing-e2e-mt-77dc65fb" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

openshift-ingress

multus

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Unhealthy

Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

ProbeError

Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 7 to 9

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Created

Container created

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-bdrxw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bdrxw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-bdrxw

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 8 to 9

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-d47676

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d47676

openshift-ingress

deployment-controller

e2e-api-a-d47676-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d47676-openshift-default-6df488c785 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-d47676-openshift-default-6df488c785

SuccessfulCreate

Created pod: e2e-api-a-d47676-openshift-default-6df488c785-gm487

openshift-ingress

multus

e2e-api-a-d47676-openshift-default-6df488c785-gm487

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bdrxw

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bdrxw

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-bdrxw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 7.962s (7.962s including waiting). Image size: 185476477 bytes.
(x9)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-api-a-fe085e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-fe085e-openshift-default-7cfdb79575 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-fe085e-openshift-default-7cfdb79575

SuccessfulCreate

Created pod: e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

openshift-ingress

gateway_labeler_controller

e2e-api-a-fe085e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-fe085e
(x10)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d47676

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d47676-668589f87f from 0 to 1

openshift-ingress

multus

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d47676-668589f87f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d47676-668589f87f-kz8h4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d47676-668589f87f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d47676-668589f87f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d47676: serviceaccount "payload-processing-e2e-api-a-d47676" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d47676

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d47676-76ff6c4867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d47676-76ff6c4867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d47676-76ff6c4867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d47676-76ff6c4867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d47676: serviceaccount "payload-processing-e2e-api-a-d47676" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 9 to 10

openshift-ingress

multus

payload-processing-e2e-api-a-d47676-668589f87f-kz8h4

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d47676-668589f87f-kz8h4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

openshift-ingress

kubelet

payload-processing-e2e-api-a-d47676-668589f87f-kz8h4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-d47676-668589f87f-kz8h4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 9 to 10
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-fe085e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-fe085e-6fd59cf677 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-fe085e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fe085e-6fd59cf677

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fe085e-6fd59cf677

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-fe085e-6fd59cf677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fe085e: serviceaccount "payload-processing-e2e-api-a-fe085e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fe085e: serviceaccount "payload-processing-e2e-api-a-fe085e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Unhealthy

Liveness probe failed: Get "https://10.132.0.50:8000/health": context deadline exceeded

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x14)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-cc2bcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cc2bcd

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-b-cc2bcd-openshift-default-d74c5c589

SuccessfulCreate

Created pod: e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

openshift-ingress

deployment-controller

e2e-api-b-cc2bcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cc2bcd-openshift-default-d74c5c589 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-77dc65fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-77dc65fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cc2bcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cc2bcd-84dfcc7d75 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cc2bcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cc2bcd-756c994b87 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cc2bcd: serviceaccount "payload-processing-e2e-api-b-cc2bcd" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cc2bcd: serviceaccount "payload-processing-e2e-api-b-cc2bcd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Unhealthy

Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

ProbeError

Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-d47676-openshift-default-6df488c785-gm487

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-d47676-openshift-default-6df488c785-gm487

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-d47676-openshift-default-6df488c785-gm487

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-b3e5f7-openshift-default-84d7d984cf

SuccessfulCreate

Created pod: e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

openshift-ingress

gateway_labeler_controller

e2e-api-b-b3e5f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b3e5f7

openshift-ingress

multus

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-b3e5f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b3e5f7-openshift-default-84d7d984cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b3e5f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b3e5f7-8675875845

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b3e5f7-8675875845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b3e5f7: serviceaccount "payload-processing-e2e-api-b-b3e5f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b3e5f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b3e5f7-8675875845 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b3e5f7: serviceaccount "payload-processing-e2e-api-b-b3e5f7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b3e5f7-8675875845

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-d47676-openshift-default-6df488c785-gm487

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-d47676-openshift-default-6df488c785-gm487

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-77dc65fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-77dc65fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d47676-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d47676-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-fe085e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-fe085e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d47676-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d47676-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-fe085e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-fe085e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-d47676-668589f87f-kz8h4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d47676-76ff6c4867-svq2p

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b3e5f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b3e5f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused

opendatahub

kubelet

test-curl-7355-8fa938

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7355-8fa938

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7355-8fa938

Started

Container started

opendatahub

kubelet

test-curl-7355-8fa938

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.365s (2.365s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7355-8fa938

Created

Container created

opendatahub

kubelet

test-curl-7355-8fa938

Killing

Stopping container test-curl-7355-8fa938

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe085e-6fd59cf677-zlp7m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe085e-7fd6c7c44c-k75k8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc2bcd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc2bcd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

Started

Container started

openshift-ingress

kubelet

e2e-api-a-d47676-openshift-default-6df488c785-gm487

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7e07c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7e07c6
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-7e07c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7e07c6-openshift-default-59b56678c9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-7e07c6-openshift-default-59b56678c9

SuccessfulCreate

Created pod: e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b3e5f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-b3e5f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-cc2bcd-84dfcc7d75-pdvzz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cc2bcd-756c994b87-hv2m8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-ghjfk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e07c6-697fc8977c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7e07c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff from 0 to 1
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-c9cn2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e07c6-697fc8977c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7e07c6-697fc8977c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e07c6: serviceaccount "payload-processing-e2e-ipp-a-7e07c6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7e07c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7e07c6-697fc8977c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e07c6: serviceaccount "payload-processing-e2e-ipp-a-7e07c6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc2bcd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cc2bcd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-fe085e-openshift-default-7cfdb79575-pm4bx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-b3e5f7-8675875845-58wlp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b3e5f7-6ddfdf758c-79tkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-cc2bcd-openshift-default-d74c5c589-nnpkj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-77dc65fb: serviceaccount "payload-processing-e2e-mt-77dc65fb" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-77dc65fb-785b45cf9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-77dc65fb-785b45cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-77dc65fb: serviceaccount "payload-processing-e2e-mt-77dc65fb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

openshift-ingress

deployment-controller

payload-processing-e2e-mt-77dc65fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-77dc65fb-785b45cf9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-77dc65fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-77dc65fb-784fcb597f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-77dc65fb-785b45cf9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

openshift-ingress

multus

payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-523de0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-523de0-openshift-default-7659bd5f45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-523de0-openshift-default-7659bd5f45

SuccessfulCreate

Created pod: e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-523de0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-523de0

openshift-ingress

multus

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-523de0-64c99495

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-523de0-64c99495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-523de0: serviceaccount "payload-processing-e2e-ipp-a-523de0" not found

openshift-ingress

kubelet

e2e-api-b-b3e5f7-openshift-default-84d7d984cf-dmbjx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-523de0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-523de0-64c99495 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-523de0: serviceaccount "payload-processing-e2e-ipp-a-523de0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-523de0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-523de0-56988c55f5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-523de0-64c99495

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-6cc3f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6cc3f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6cc3f7

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5

SuccessfulCreate

Created pod: e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

openshift-ingress

multus

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6cc3f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cc3f7: serviceaccount "payload-processing-e2e-ipp-a-6cc3f7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6cc3f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6cc3f7-854f9d8497 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cc3f7: serviceaccount "payload-processing-e2e-ipp-a-6cc3f7" not found

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9d12c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9d12c2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-78788df4ff-6p4rd

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-9d12c2-openshift-default-64d7d69647

SuccessfulCreate

Created pod: e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

openshift-ingress

deployment-controller

e2e-ipp-b-9d12c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9d12c2-openshift-default-64d7d69647 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-697fc8977c-8vvmc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

Created

Container created

openshift-ingress

multus

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9d12c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9d12c2-c8b5cd885 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d12c2: serviceaccount "payload-processing-e2e-ipp-b-9d12c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d12c2: serviceaccount "payload-processing-e2e-ipp-b-9d12c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9d12c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-ftdzx

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7e07c6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7e07c6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.53s (2.53s including waiting). Image size: 185476477 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7e07c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7e07c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e07c6: serviceaccount "payload-processing-e2e-ipp-a-7e07c6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e07c6: serviceaccount "payload-processing-e2e-ipp-a-7e07c6" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

openshift-ingress

multus

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-5a032f-openshift-default-5bb6d5df59

SuccessfulCreate

Created pod: e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

openshift-ingress

gateway_labeler_controller

e2e-api-a-5a032f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5a032f

openshift-ingress

deployment-controller

e2e-api-a-5a032f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5a032f-openshift-default-5bb6d5df59 from 0 to 1

openshift-ingress

multus

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7355-dac468

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.167s (3.167s including waiting). Image size: 166620835 bytes.

opendatahub

multus

test-curl-7355-dac468

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

Created

Container created

opendatahub

kubelet

test-curl-7355-dac468

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

Started

Container started

opendatahub

kubelet

test-curl-7355-dac468

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.823s (3.823s including waiting). Image size: 166620835 bytes.

opendatahub

kubelet

test-curl-7355-dac468

Killing

Stopping container test-curl-7355-dac468

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5a032f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5a032f-75cd84b75f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5a032f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5a032f-5f87f8ff7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5a032f-5f87f8ff7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5a032f: serviceaccount "payload-processing-e2e-api-a-5a032f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5a032f-5f87f8ff7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5a032f-5f87f8ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5a032f: serviceaccount "payload-processing-e2e-api-a-5a032f" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7e07c6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7e07c6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-523de0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-523de0-openshift-default-7659bd5f45

SuccessfulCreate

Created pod: e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

openshift-ingress

replicaset-controller

e2e-ipp-a-523de0-openshift-default-7659bd5f45

SuccessfulCreate

Created pod: e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

openshift-ingress

replicaset-controller

e2e-ipp-a-523de0-openshift-default-7659bd5f45

SuccessfulCreate

Created pod: e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

Created

Container created

openshift-ingress

multus

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-523de0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-523de0-openshift-default-7659bd5f45 from 1 to 4

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

Created

Container created

openshift-ingress

multus

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-56988c55f5-kkctl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-64c99495-bvdn7

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-523de0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-523de0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-854f9d8497-frzzk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-5f46dfcf79-hvhbx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-523de0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-523de0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-c8b5cd885-gg7gm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-5878b4575-cg865

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-523de0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-523de0-78f4cd5c96 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-523de0-78f4cd5c96

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-523de0-896768d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-523de0-896768d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-523de0-896768d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-523de0: serviceaccount "payload-processing-e2e-ipp-a-523de0" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-523de0-78f4cd5c96

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-523de0-78f4cd5c96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-523de0: serviceaccount "payload-processing-e2e-ipp-a-523de0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-523de0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-523de0-896768d7f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Unhealthy

Readiness probe failed: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

ProbeError

Readiness probe error: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-77dc65fb-785b45cf9-k64dt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-77dc65fb-784fcb597f-n2fvj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cc3f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cc3f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6cc3f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cc3f7: serviceaccount "payload-processing-e2e-ipp-a-6cc3f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6cc3f7: serviceaccount "payload-processing-e2e-ipp-a-6cc3f7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6cc3f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d12c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d12c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

Started

Container started

openshift-ingress

deployment-controller

e2e-api-b-54fd3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-54fd3c-openshift-default-694d595797 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-54fd3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-54fd3c

openshift-ingress

replicaset-controller

e2e-api-b-54fd3c-openshift-default-694d595797

SuccessfulCreate

Created pod: e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

openshift-ingress

deployment-controller

e2e-ipp-b-b2cc1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b2cc1f-openshift-default-866f47f48c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c

SuccessfulCreate

Created pod: e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b2cc1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b2cc1f

openshift-ingress

multus

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cc3f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-6cc3f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d12c2: serviceaccount "payload-processing-e2e-ipp-b-9d12c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9d12c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9d12c2-746c854599 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9d12c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d12c2: serviceaccount "payload-processing-e2e-ipp-b-9d12c2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-54fd3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-54fd3c-7644ff887 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-54fd3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-54fd3c-59c4459b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-54fd3c: serviceaccount "payload-processing-e2e-api-b-54fd3c" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-54fd3c-7644ff887

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-54fd3c-7644ff887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-54fd3c: serviceaccount "payload-processing-e2e-api-b-54fd3c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-54fd3c-7644ff887

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

openshift-ingress

multus

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-dc62c2-openshift-default-995df4cd9

SuccessfulCreate

Created pod: e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b2cc1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2cc1f: serviceaccount "payload-processing-e2e-ipp-b-b2cc1f" not found

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-dc62c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-dc62c2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d12c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d12c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2cc1f: serviceaccount "payload-processing-e2e-ipp-b-b2cc1f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b2cc1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-b-dc62c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-dc62c2-openshift-default-995df4cd9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5a032f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5a032f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dc62c2: serviceaccount "payload-processing-e2e-ipp-b-dc62c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dc62c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dc62c2: serviceaccount "payload-processing-e2e-ipp-b-dc62c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dc62c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

openshift-ingress

multus

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65

Started

Container started

openshift-ingress

kubelet

e2e-mt-77dc65fb-openshift-default-b6b44599c-htvdk

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5a032f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5a032f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-688jz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-688jz

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-9zbxj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 10 to 8

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e07c6-79cff67d6c-glkfq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e07c6-85cffcc7fd-gh2rn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-7e07c6-openshift-default-59b56678c9-f6dfm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Unhealthy

Readiness probe failed: Get "http://10.132.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

ProbeError

Readiness probe error: Get "http://10.132.0.157:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Unhealthy

Readiness probe failed: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-77795b444c-5p7vj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

ProbeError

Readiness probe error: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

openshift-ingress

kubelet

payload-processing-e2e-api-a-5a032f-5f87f8ff7-nfkgf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-5sbrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5a032f-75cd84b75f-5hxjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-dq6fv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8thl2

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-6wtst

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-txc78

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 8 to 7

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-txc78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Unhealthy

Readiness probe failed: Get "http://10.132.0.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

ProbeError

Readiness probe error: Get "http://10.132.0.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-d4b4d7cdf-55lrp

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.160:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-8fdc4fdff-cjb65

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-56869f88f5-jmjlt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2cc1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2cc1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d12c2-67bcb7fc86-7svt4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d12c2-746c854599-lqwjv

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-fmr4v

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-lml2p

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-smwp2

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 10 to 7

openshift-ingress

kubelet

e2e-api-a-5a032f-openshift-default-5bb6d5df59-5fpmv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b2cc1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b2cc1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2cc1f: serviceaccount "payload-processing-e2e-ipp-b-b2cc1f" not found

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b2cc1f: serviceaccount "payload-processing-e2e-ipp-b-b2cc1f" not found

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

openshift-ingress

kubelet

e2e-ipp-b-9d12c2-openshift-default-64d7d69647-5vv6t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-b7fde8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b7fde8-openshift-default-764f58bbb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5

SuccessfulCreate

Created pod: e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b7fde8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b7fde8

openshift-ingress

multus

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-54fd3c-7644ff887-l97ct

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-54fd3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-54fd3c-59c4459b79-5q742

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-54fd3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b7fde8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b7fde8: serviceaccount "payload-processing-e2e-praxis-a-b7fde8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b7fde8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b7fde8: serviceaccount "payload-processing-e2e-praxis-a-b7fde8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dc62c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dc62c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dc62c2: serviceaccount "payload-processing-e2e-ipp-b-dc62c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dc62c2: serviceaccount "payload-processing-e2e-ipp-b-dc62c2" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

openshift-ingress

multus

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-8w8jf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-9h8xh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dhjw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-vcww6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-d74vh
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-54fd3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2cc1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b2cc1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-54fd3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-523de0-78f4cd5c96-w5dgl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-523de0-896768d7f-m8784

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-54fd3c-openshift-default-694d595797-bw5dd

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dc62c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dc62c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-mkbg8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-xxc6l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-zx8hz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9f3716

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9f3716

openshift-ingress

kubelet

e2e-ipp-a-523de0-openshift-default-7659bd5f45-95s5j

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b7fde8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf

SuccessfulCreate

Created pod: e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

openshift-ingress

deployment-controller

e2e-ipp-a-9f3716-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b7fde8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9f3716

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9f3716

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9f3716-78bc6c89df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f3716: serviceaccount "payload-processing-e2e-ipp-a-9f3716" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f3716-78bc6c89df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f3716-78bc6c89df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9f3716-78bc6c89df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f3716: serviceaccount "payload-processing-e2e-ipp-a-9f3716" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b2cc1f-6fbd798fd-l48h7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b2cc1f-7ff4fc98c5-bvxj6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-b2cc1f-openshift-default-866f47f48c-hwn7l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7

SuccessfulCreate

Created pod: e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d60b29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d60b29

openshift-ingress

deployment-controller

e2e-praxis-a-d60b29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d60b29: serviceaccount "payload-processing-e2e-praxis-a-d60b29" not found

openshift-ingress

replicaset-controller

e2e-praxis-b-b2023a-openshift-default-d7cc9c877

SuccessfulCreate

Created pod: e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b2023a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b2023a

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d60b29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6cc3f7-54d8776fcd-wsckq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6cc3f7-56bc5549d7-l8v2c

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-praxis-b-b2023a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b2023a-openshift-default-d7cc9c877 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d60b29-758d9497c7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d60b29-758d9497c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d60b29: serviceaccount "payload-processing-e2e-praxis-a-d60b29" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d60b29-758d9497c7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d60b29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d60b29-758d9497c7 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b2023a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b2023a-84bcd7967c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b2023a: serviceaccount "payload-processing-e2e-praxis-b-b2023a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b2023a-84bcd7967c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b2023a-84bcd7967c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b2023a: serviceaccount "payload-processing-e2e-praxis-b-b2023a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b2023a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b2023a-84bcd7967c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-16e21e-openshift-default-66957c786c

SuccessfulCreate

Created pod: e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-16e21e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-16e21e

openshift-ingress

deployment-controller

e2e-ipp-a-16e21e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-16e21e-openshift-default-66957c786c from 0 to 1

openshift-ingress

multus

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-6cc3f7-openshift-default-5cbd84bc5-5s4f6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Unhealthy

Readiness probe failed: Get "http://10.133.0.124:15021/healthz/ready": read tcp 10.133.0.2:41296->10.133.0.124:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

ProbeError

Readiness probe error: Get "http://10.133.0.124:15021/healthz/ready": read tcp 10.133.0.2:41296->10.133.0.124:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-16e21e: serviceaccount "payload-processing-e2e-ipp-a-16e21e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-16e21e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-16e21e-b48767f89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-16e21e-b48767f89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-16e21e-b48767f89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-16e21e-b48767f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-16e21e: serviceaccount "payload-processing-e2e-ipp-a-16e21e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-16e21e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dc62c2-56bdf69b9b-vxfq5

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dc62c2-85c7dcb6c-5jz77

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-dc62c2-openshift-default-995df4cd9-ccpjq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-7fcdbcfb99-tdn8v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-78bc6c89df-jvdjb

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-894bbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-894bbb

openshift-ingress

deployment-controller

e2e-praxis-a-894bbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-894bbb-openshift-default-8d84c79f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-894bbb-openshift-default-8d84c79f7

SuccessfulCreate

Created pod: e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

openshift-ingress

multus

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bhdc5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 10 to 7

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-kf9wt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zvg54

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-894bbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-894bbb-797cb7cc4f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-894bbb: serviceaccount "payload-processing-e2e-praxis-a-894bbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-894bbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-894bbb: serviceaccount "payload-processing-e2e-praxis-a-894bbb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f3716-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f3716-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b7fde8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b7fde8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9f3716

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9f3716-6448f975db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f3716: serviceaccount "payload-processing-e2e-ipp-a-9f3716" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f3716-6448f975db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9f3716

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9f3716-6448f975db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9f3716-6448f975db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9f3716: serviceaccount "payload-processing-e2e-ipp-a-9f3716" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c

SuccessfulCreate

Created pod: e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

openshift-ingress

deployment-controller

e2e-praxis-b-b2f76f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b2f76f-openshift-default-74dfd8679c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b2f76f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b2f76f

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb

Started

Container started

openshift-ingress

multus

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b2f76f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b2f76f-576784f587 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b2f76f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b2f76f: serviceaccount "payload-processing-e2e-praxis-b-b2f76f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b2f76f-576784f587

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b2f76f-576784f587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b2f76f: serviceaccount "payload-processing-e2e-praxis-b-b2f76f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b2f76f-576784f587

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-b652g

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-b652g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-k9x79

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 10 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-68twk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-68twk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-k9x79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

ProbeError

Readiness probe error: Get "http://10.133.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Unhealthy

Readiness probe failed: Get "http://10.133.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-894bbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-894bbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

ProbeError

Readiness probe error: Get "http://10.133.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Unhealthy

Readiness probe failed: Get "http://10.133.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b7fde8-5b8cc64cd7-d9lhh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b7fde8-56fdc75bc5-nnc4d

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2023a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2023a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-ipp-b-eb64ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-eb64ad-openshift-default-56856d5c57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-eb64ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-eb64ad

openshift-ingress

multus

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-eb64ad-openshift-default-56856d5c57

SuccessfulCreate

Created pod: e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-b48767f89-cb28k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-8688bfc8dc-f9rdr

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb64ad: serviceaccount "payload-processing-e2e-ipp-b-eb64ad" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eb64ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eb64ad-69b9695ff from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb64ad-69b9695ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eb64ad-69b9695ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb64ad: serviceaccount "payload-processing-e2e-ipp-b-eb64ad" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eb64ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb64ad-69b9695ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n
(x7)

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b7fde8-openshift-default-764f58bbb5-lwp2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d60b29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d60b29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f3716-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9f3716-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2023a-654d66dc7f-68dlk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2023a-84bcd7967c-hsvxb

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d60b29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d60b29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-16e21e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-16e21e-6f656f9df4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-16e21e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-16e21e: serviceaccount "payload-processing-e2e-ipp-a-16e21e" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-16e21e-6f656f9df4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-16e21e-6f656f9df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-16e21e: serviceaccount "payload-processing-e2e-ipp-a-16e21e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-16e21e-6f656f9df4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

openshift-ingress

multus

payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-11b2e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-11b2e0

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 7 to 6

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

openshift-ingress

replicaset-controller

e2e-praxis-b-11b2e0-openshift-default-69868c7689

SuccessfulCreate

Created pod: e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ncrlf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-b-11b2e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-11b2e0-openshift-default-69868c7689 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

ProbeError

Readiness probe error: Get "http://10.133.0.145:15021/healthz/ready": read tcp 10.133.0.2:52078->10.133.0.145:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Unhealthy

Readiness probe failed: Get "http://10.133.0.145:15021/healthz/ready": read tcp 10.133.0.2:52078->10.133.0.145:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-11b2e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-11b2e0-57f6455547 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-11b2e0-57f6455547

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-11b2e0-57f6455547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-11b2e0: serviceaccount "payload-processing-e2e-praxis-b-11b2e0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-11b2e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

openshift-ingress

multus

payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-11b2e0: serviceaccount "payload-processing-e2e-praxis-b-11b2e0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-11b2e0-57f6455547

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-16e21e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-16e21e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 7 to 6

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-677726

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-677726

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-nk2tp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-b-677726-openshift-default-6c9cff679f

SuccessfulCreate

Created pod: e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

openshift-ingress

multus

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-677726-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-677726-openshift-default-6c9cff679f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2f76f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2f76f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-677726

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-677726-699b6cbdf7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-677726

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f from 0 to 1
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2023a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2023a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-677726: serviceaccount "payload-processing-e2e-ipp-b-677726" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-677726-699b6cbdf7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-677726-699b6cbdf7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-677726-699b6cbdf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-677726: serviceaccount "payload-processing-e2e-ipp-b-677726" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-b2023a-openshift-default-d7cc9c877-v2w28

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d60b29-6b5cdf4959-fdvcm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d60b29-758d9497c7-mqhd7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-69486cb6f5-znh9n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-69b9695ff-kkw2n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-d60b29-openshift-default-8f7bcb7f7-27t77

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-894bbb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-894bbb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b2f76f-576784f587-hk79x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b2f76f-67bcd7cb8c-4bksf

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eb64ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eb64ad-6db8db6f44 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb64ad: serviceaccount "payload-processing-e2e-ipp-b-eb64ad" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eb64ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eb64ad: serviceaccount "payload-processing-e2e-ipp-b-eb64ad" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2f76f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b2f76f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-b2f76f-openshift-default-74dfd8679c-sr5kc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-6c9ddcb55f-grwgm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-699b6cbdf7-nbzbh

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 6 to 10

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-11b2e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-11b2e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eb64ad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-eb64ad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9f3716-6448f975db-4ftsv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9f3716-79db7bb5c9-dbdmb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-677726-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-677726-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-11b2e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-11b2e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-677726

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-677726-78868ff7c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-677726: serviceaccount "payload-processing-e2e-ipp-b-677726" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-677726

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-677726-766f5b99ff from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-677726-78868ff7c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-677726-78868ff7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-677726: serviceaccount "payload-processing-e2e-ipp-b-677726" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-677726-78868ff7c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

openshift-ingress

multus

payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 6 to 5

openshift-ingress

kubelet

e2e-ipp-a-9f3716-openshift-default-67dfcf5dcf-xvsg6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-zhkkt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-f89vf

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

ProbeError

Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-nbsgm

Unhealthy

Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-626zl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-626zl

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-xxtg2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eb64ad-7cf5b9c887-4llfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eb64ad-6db8db6f44-ghlhd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-3624d8-openshift-default-6556748985

SuccessfulCreate

Created pod: e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

openshift-ingress

deployment-controller

e2e-praxis-a-3624d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3624d8-openshift-default-6556748985 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3624d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3624d8

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Created

Container created

openshift-ingress

multus

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-eb64ad-openshift-default-56856d5c57-ngg2z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3624d8: serviceaccount "payload-processing-e2e-praxis-a-3624d8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3624d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3624d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3624d8-7d7f54d85c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3624d8: serviceaccount "payload-processing-e2e-praxis-a-3624d8" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

Started

Container started

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-677726-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-677726-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

Unhealthy

Startup probe failed: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

ProbeError

Startup probe error: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

ProbeError

Startup probe error: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

Unhealthy

Startup probe failed: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused
(x10)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z96hl

Unhealthy

Readiness probe failed: Get "https://10.132.0.50:8000/ready": context deadline exceeded

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-mqr2s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-9ab4d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-9ab4d2

openshift-ingress

deployment-controller

e2e-praxis-b-9ab4d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-29cwt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 5 to 4
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3624d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3624d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9ab4d2: serviceaccount "payload-processing-e2e-praxis-b-9ab4d2" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9ab4d2: serviceaccount "payload-processing-e2e-praxis-b-9ab4d2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-9ab4d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-9ab4d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-9ab4d2-5fc987db45 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3624d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3624d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-894bbb-797cb7cc4f-4hm9b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-894bbb-54c8bb7567-922f5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

Started

Container started

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

Created

Container created

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-b-9ab4d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9ab4d2-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-894bbb-openshift-default-8d84c79f7-wqbgk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-a-w4-9877ce-openshift-default-68479d46df

SuccessfulCreate

Created pod: e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-12df3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-12df3c

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-9877ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-9877ce

openshift-ingress

deployment-controller

e2e-shared-a-w4-9877ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-9877ce-openshift-default-68479d46df from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-a-w3-12df3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59

SuccessfulCreate

Created pod: e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-9877ce: serviceaccount "payload-processing-e2e-shared-a-w4-9877ce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-9877ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-9877ce: serviceaccount "payload-processing-e2e-shared-a-w4-9877ce" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-9877ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-12df3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-11b2e0-fc9fb8dcf-s68lk

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-12df3c: serviceaccount "payload-processing-e2e-shared-a-w3-12df3c" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-11b2e0-57f6455547-2zhr5

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-12df3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-12df3c: serviceaccount "payload-processing-e2e-shared-a-w3-12df3c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9ab4d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9ab4d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3624d8-7d7f54d85c-k6fpm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3624d8-694f97cbcf-hl76g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-3624d8-openshift-default-6556748985-6f9hw

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-9ab4d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc from 4 to 8

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9ab4d2-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9ab4d2-6856cc9f8c-lrdvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9ab4d2-5fc987db45-xp2gk

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

ProbeError

Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-11b2e0-openshift-default-69868c7689-tpds4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-99lqk

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 7 to 6
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

Unhealthy

Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-99lqk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

(combined from similar events): Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

openshift-ingress

replicaset-controller

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc

SuccessfulCreate

Created pod: e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9ab4d2-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

e2e-praxis-b-9ab4d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc from 8 to 10

openshift-ingress

multus

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

Unhealthy

Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

ProbeError

Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Unhealthy

Readiness probe failed: Get "http://10.132.0.204:15021/healthz/ready": read tcp 10.132.0.2:43794->10.132.0.204:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

ProbeError

Readiness probe error: Get "http://10.132.0.204:15021/healthz/ready": read tcp 10.132.0.2:43794->10.132.0.204:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-7f19e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-7f19e8

openshift-ingress

multus

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-2q86f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-9sm77

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc

SuccessfulCreate

Created pod: e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-x87j5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc

SuccessfulCreate

Created pod: e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-32ea65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-32ea65

openshift-ingress

deployment-controller

e2e-shared-b-w4-7f19e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-t7mrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-j8796

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-32ea65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-32ea65-openshift-default-595544d6dc from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lrr2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-6rhpx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-lhpjp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-qbdvf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9ab4d2-openshift-default-9f4954bfc-gjx6r

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-56bbb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-56bbb6

openshift-ingress

deployment-controller

e2e-shared-b-w3-56bbb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c

SuccessfulCreate

Created pod: e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

openshift-ingress

multus

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-7f19e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-7f19e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-7f19e8: serviceaccount "payload-processing-e2e-shared-b-w4-7f19e8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-7f19e8: serviceaccount "payload-processing-e2e-shared-b-w4-7f19e8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-32ea65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-32ea65-798cd6f665 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-32ea65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-32ea65: serviceaccount "payload-processing-e2e-shared-a-w0-32ea65" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-56bbb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-32ea65: serviceaccount "payload-processing-e2e-shared-a-w0-32ea65" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-56bbb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9877ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-56bbb6: serviceaccount "payload-processing-e2e-shared-b-w3-56bbb6" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9877ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-56bbb6: serviceaccount "payload-processing-e2e-shared-b-w3-56bbb6" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w1-e4c131-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf

SuccessfulCreate

Created pod: e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-e4c131

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-e4c131

openshift-ingress

multus

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16e21e-6f656f9df4-chqqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16e21e-5b99c4d595-ntr8n

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-e4c131: serviceaccount "payload-processing-e2e-shared-a-w1-e4c131" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-e4c131

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-e4c131: serviceaccount "payload-processing-e2e-shared-a-w1-e4c131" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-e4c131

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 4 to 5

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9877ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9877ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-16e21e-openshift-default-66957c786c-t7mzt

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

Unhealthy

Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

ProbeError

Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulCreate

Created pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

openshift-ingress

multus

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-12df3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-12df3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

ProbeError

Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

Unhealthy

Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

ProbeError

Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

Unhealthy

Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-677726-78868ff7c8-sfp64

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-677726-766f5b99ff-c5hbw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-677726-openshift-default-6c9cff679f-tfmfx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c7a27f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c7a27f

openshift-ingress

deployment-controller

e2e-praxis-a-c7a27f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c7a27f-openshift-default-549db5f865 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-c7a27f-openshift-default-549db5f865

SuccessfulCreate

Created pod: e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

openshift-ingress

multus

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-12df3c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-12df3c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-3575b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-3575b9

openshift-ingress

deployment-controller

e2e-shared-b-w0-3575b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7

SuccessfulCreate

Created pod: e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

Created

Container created

openshift-ingress

multus

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c7a27f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c7a27f: serviceaccount "payload-processing-e2e-praxis-a-c7a27f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c7a27f: serviceaccount "payload-processing-e2e-praxis-a-c7a27f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c7a27f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c7a27f-85d5f4c795 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7f19e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7f19e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-3575b9: serviceaccount "payload-processing-e2e-shared-b-w0-3575b9" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-3575b9: serviceaccount "payload-processing-e2e-shared-b-w0-3575b9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-3575b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-3575b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Unhealthy

Readiness probe failed: Get "http://10.133.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

ProbeError

Readiness probe error: Get "http://10.133.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-xtlwr

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-n6cpx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-3575b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-3575b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w1-6929a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-6929a4-openshift-default-6c5447865 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-6929a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-6929a4

openshift-ingress

multus

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-6929a4-openshift-default-6c5447865

SuccessfulCreate

Created pod: e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-32ea65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Unhealthy

Startup probe failed: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

ProbeError

Startup probe error: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-32ea65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Unhealthy

Readiness probe failed: Get "http://10.133.0.188:15021/healthz/ready": read tcp 10.133.0.2:46604->10.133.0.188:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

ProbeError

Readiness probe error: Get "http://10.133.0.188:15021/healthz/ready": read tcp 10.133.0.2:46604->10.133.0.188:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-6929a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-6929a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-6929a4: serviceaccount "payload-processing-e2e-shared-b-w1-6929a4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-6929a4: serviceaccount "payload-processing-e2e-shared-b-w1-6929a4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

ProbeError

Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Unhealthy

Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7f19e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-32ea65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7f19e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-32ea65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-56bbb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-56bbb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-56bbb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-56bbb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-680c01-openshift-default-7fcbcfd5

SuccessfulCreate

Created pod: e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-680c01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-680c01

openshift-ingress

deployment-controller

e2e-praxis-b-680c01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-680c01-openshift-default-7fcbcfd5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e4c131-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e4c131-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-680c01-df649b747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-680c01-df649b747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-680c01: serviceaccount "payload-processing-e2e-praxis-b-680c01" not found

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Unhealthy

Readiness probe failed: Get "http://10.132.0.216:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-680c01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-680c01-784857fb69 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

ProbeError

Readiness probe error: Get "http://10.132.0.216:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-680c01-df649b747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-680c01-784857fb69

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-680c01-784857fb69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-680c01: serviceaccount "payload-processing-e2e-praxis-b-680c01" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-680c01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-680c01-df649b747 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-680c01-784857fb69

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c7a27f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c7a27f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Unhealthy

Startup probe failed: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

ProbeError

Startup probe error: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-3575b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-3575b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-6929a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-6929a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c7a27f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c7a27f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

ProbeError

Readiness probe error: Get "http://10.132.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Unhealthy

Readiness probe failed: Get "http://10.132.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-6929a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-6929a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c7a27f-85d5f4c795-62hq7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c7a27f-867c5cd867-g4wrb

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-680c01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-680c01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-c7a27f-openshift-default-549db5f865-2d6f4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-680c01-784857fb69-jhn2f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-680c01-df649b747-mdxbm

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-680c01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-680c01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-680c01-openshift-default-7fcbcfd5-bqwtt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-ac716b-openshift-default-5c495d47c

SuccessfulCreate

Created pod: e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

openshift-ingress

deployment-controller

e2e-explicit-ac716b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-ac716b-openshift-default-5c495d47c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-ac716b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-ac716b

openshift-ingress

multus

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ac716b: serviceaccount "payload-processing-e2e-explicit-ac716b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ac716b-6b7ffb894f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-ac716b-6b7ffb894f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-ac716b: serviceaccount "payload-processing-e2e-explicit-ac716b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-ac716b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-ac716b-7b9585cc95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-ac716b-6b7ffb894f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-ac716b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-ac716b-6b7ffb894f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

openshift-ingress

kubelet

payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-mxbss

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-5qm2s

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-ct9fd

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 10 to 9
(x2)

openshift-ingress

kubelet

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-ftdzx

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-ftdzx

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-gbc5g

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-d2sj7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cljsc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 6 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-cljsc

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 9 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qzfk4

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-sb94t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-qmcj5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-d2sj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-ac716b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-ac716b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-ac716b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-ac716b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-7361-149f84

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-149f84

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7361-149f84

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.114s (2.114s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7361-149f84

Created

Container created

opendatahub

kubelet

test-curl-7361-149f84

Started

Container started

opendatahub

kubelet

test-curl-7361-149f84

Killing

Stopping container test-curl-7361-149f84

opendatahub

kubelet

test-curl-7361-22fe8c

Created

Container created

opendatahub

kubelet

test-curl-7361-22fe8c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7361-22fe8c

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-22fe8c

Started

Container started

opendatahub

kubelet

test-curl-7361-22fe8c

Killing

Stopping container test-curl-7361-22fe8c

opendatahub

kubelet

test-curl-7361-f96a04

Started

Container started

opendatahub

multus

test-curl-7361-f96a04

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-f96a04

Created

Container created

opendatahub

kubelet

test-curl-7361-f96a04

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-4fpwg

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7361-901598

Started

Container started

opendatahub

kubelet

test-curl-7361-901598

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7361-f96a04

Killing

Stopping container test-curl-7361-f96a04

opendatahub

multus

test-curl-7361-901598

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-901598

Created

Container created

opendatahub

kubelet

test-curl-7361-7d48e3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7361-7d48e3

Created

Container created

opendatahub

kubelet

test-curl-7361-7d48e3

Started

Container started

opendatahub

kubelet

test-curl-7361-901598

Killing

Stopping container test-curl-7361-901598

opendatahub

multus

test-curl-7361-7d48e3

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-1277d5

Created

Container created

opendatahub

kubelet

test-curl-7361-1277d5

Started

Container started

opendatahub

kubelet

test-curl-7361-7d48e3

Killing

Stopping container test-curl-7361-7d48e3

opendatahub

kubelet

test-curl-7361-1277d5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7361-1277d5

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-1277d5

Killing

Stopping container test-curl-7361-1277d5

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c712b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c712b1

openshift-ingress

deployment-controller

e2e-extmod-a-c712b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c712b1-openshift-default-565f6f489 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-c712b1-openshift-default-565f6f489

SuccessfulCreate

Created pod: e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

openshift-ingress

multus

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c712b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c712b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c712b1-f8c68f96c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c712b1-f8c68f96c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c712b1-f8c68f96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c712b1: serviceaccount "payload-processing-e2e-extmod-a-c712b1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c712b1-f8c68f96c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c712b1: serviceaccount "payload-processing-e2e-extmod-a-c712b1" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-8vbb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-chs7j

openshift-ingress

kubelet

payload-processing-e2e-explicit-ac716b-6b7ffb894f-dxs2l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-ac716b-7b9585cc95-zwtjf

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-696c7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-696c7a
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 3 to 2

openshift-ingress

multus

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

openshift-ingress

replicaset-controller

e2e-extmod-a-696c7a-openshift-default-67695fc869

SuccessfulCreate

Created pod: e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

openshift-ingress

deployment-controller

e2e-extmod-a-696c7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-696c7a-openshift-default-67695fc869 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-f5q9f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-696c7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-696c7a-d6965f547 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-696c7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-696c7a-787b4845b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-696c7a: serviceaccount "payload-processing-e2e-extmod-a-696c7a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-696c7a-787b4845b7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-696c7a-787b4845b7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-696c7a-787b4845b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-696c7a: serviceaccount "payload-processing-e2e-extmod-a-696c7a" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-tzjqf

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7352-76e02c

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7352-76e02c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7352-76e02c

Created

Container created

opendatahub

kubelet

test-curl-7352-76e02c

Started

Container started

openshift-ingress

kubelet

e2e-explicit-ac716b-openshift-default-5c495d47c-bggbq

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7352-76e02c

Killing

Stopping container test-curl-7352-76e02c

openshift-ingress

gateway_labeler_controller

e2e-noten-7f38f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-7f38f1

openshift-ingress

deployment-controller

e2e-noten-7f38f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-7f38f1-openshift-default-59c89b95 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-7f38f1-openshift-default-59c89b95

SuccessfulCreate

Created pod: e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

openshift-ingress

kubelet

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

Started

Container started

openshift-ingress

kubelet

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

Created

Container created

openshift-ingress

multus

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-ztngm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-4rlvm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-3575b9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w0-3575b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7

SuccessfulCreate

Created pod: e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-7f38f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Started

Container started

openshift-ingress

multus

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-7f38f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-6929a4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w1-6929a4-openshift-default-6c5447865

SuccessfulCreate

Created pod: e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w1-6929a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-6929a4-openshift-default-6c5447865 from 1 to 2

openshift-ingress

multus

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Unhealthy

Startup probe failed: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-vrrvc

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

ProbeError

Startup probe error: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused body:
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 6 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 4 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-8fmqz

openshift-ingress

kubelet

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-9khqq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c712b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c712b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Created

Container created

openshift-ingress

kubelet

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-7f38f1-openshift-default-59c89b95-f78n4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8fmqz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-b29lp

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-736f7c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-736f7c

openshift-ingress

deployment-controller

e2e-extmod-a-736f7c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-736f7c-openshift-default-56685bb6d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-736f7c-openshift-default-56685bb6d5

SuccessfulCreate

Created pod: e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

openshift-ingress

multus

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-bb4907-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-bb4907-openshift-default-5d449c9f5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c

SuccessfulCreate

Created pod: e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-bb4907

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-bb4907

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-736f7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-736f7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-736f7c-b8cfc9767 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-736f7c-b8cfc9767

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-736f7c-b8cfc9767

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-736f7c-b8cfc9767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-736f7c: serviceaccount "payload-processing-e2e-extmod-a-736f7c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-736f7c: serviceaccount "payload-processing-e2e-extmod-a-736f7c" not found

openshift-ingress

multus

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

Created

Container created

openshift-ingress

replicaset-controller

e2e-autores-7a8bb6-openshift-default-7f996bcbf5

SuccessfulCreate

Created pod: e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

openshift-ingress

deployment-controller

e2e-autores-7a8bb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-7a8bb6-openshift-default-7f996bcbf5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-7a8bb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-7a8bb6

openshift-ingress

multus

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bb4907: serviceaccount "payload-processing-e2e-extmod-b-bb4907" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-bb4907: serviceaccount "payload-processing-e2e-extmod-b-bb4907" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-bb4907

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-bb4907

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7a8bb6-7d87956497

SuccessfulCreate

Created pod: payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-7a8bb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-7a8bb6-bb857998c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7a8bb6-7d87956497

FailedCreate

Error creating: pods "payload-processing-e2e-autores-7a8bb6-7d87956497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7a8bb6: serviceaccount "payload-processing-e2e-autores-7a8bb6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-autores-7a8bb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-7a8bb6-7d87956497 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7a8bb6-bb857998c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-7a8bb6-bb857998c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7a8bb6: serviceaccount "payload-processing-e2e-autores-7a8bb6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7a8bb6-bb857998c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

openshift-ingress

kubelet

payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-643355-openshift-default-77b8b64ffc

SuccessfulCreate

Created pod: e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-643355

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-643355

openshift-ingress

deployment-controller

e2e-extmod-b-643355-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-643355-openshift-default-77b8b64ffc from 0 to 1

openshift-ingress

multus

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-643355-77d866896c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-643355-77d866896c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-643355: serviceaccount "payload-processing-e2e-extmod-b-643355" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-643355-75b78974f7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-643355-75b78974f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-643355: serviceaccount "payload-processing-e2e-extmod-b-643355" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-643355-75b78974f7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-643355

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-643355-75b78974f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-643355-77d866896c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-643355

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-643355-77d866896c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-736f7c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-736f7c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-ea9556-openshift-default-767c695d45

SuccessfulCreate

Created pod: e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

openshift-ingress

deployment-controller

e2e-extmod-a-ea9556-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ea9556-openshift-default-767c695d45 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ea9556

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ea9556

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bb4907-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bb4907-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c712b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c712b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ea9556

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ea9556: serviceaccount "payload-processing-e2e-extmod-a-ea9556" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ea9556

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ea9556-7df86d994f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ea9556-7df86d994f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ea9556-7df86d994f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ea9556-7df86d994f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ea9556: serviceaccount "payload-processing-e2e-extmod-a-ea9556" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696c7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696c7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

ProbeError

Startup probe error: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Unhealthy

Startup probe failed: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696c7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-696c7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-736f7c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-736f7c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-2dde84-openshift-default-799f6d654f

SuccessfulCreate

Created pod: e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

openshift-ingress

deployment-controller

e2e-extmod-b-2dde84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2dde84-openshift-default-799f6d654f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2dde84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2dde84
(x2)

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Created

Container created

openshift-ingress

multus

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

Unhealthy

Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

ProbeError

Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

ProbeError

Startup probe error: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Unhealthy

Startup probe failed: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2dde84-5d85974555

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2dde84-5d85974555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2dde84: serviceaccount "payload-processing-e2e-extmod-b-2dde84" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2dde84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2dde84-5d85974555 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2dde84: serviceaccount "payload-processing-e2e-extmod-b-2dde84" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2dde84-5d85974555

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2dde84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7a8bb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7a8bb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

ProbeError

Readiness probe error: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Unhealthy

Readiness probe failed: Get "http://10.132.0.255:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Unhealthy

Startup probe failed: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

ProbeError

Startup probe error: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

ProbeError

Startup probe error: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Unhealthy

Startup probe failed: Get "http://10.132.0.255:15021/healthz/ready": dial tcp 10.132.0.255:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7a8bb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7a8bb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-71a41c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-71a41c

openshift-ingress

replicaset-controller

e2e-extmod-b-71a41c-openshift-default-668c99ff8f

SuccessfulCreate

Created pod: e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

openshift-ingress

deployment-controller

e2e-extmod-b-71a41c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-71a41c-openshift-default-668c99ff8f from 0 to 1

openshift-ingress

multus

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ea9556-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bb4907-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-bb4907-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ea9556-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-71a41c: serviceaccount "payload-processing-e2e-extmod-b-71a41c" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-71a41c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-71a41c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bph7h

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-71a41c: serviceaccount "payload-processing-e2e-extmod-b-71a41c" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

AddedInterface

Add eth0 [10.132.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-m4f8x

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ea9556-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ea9556-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-lgzxc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bfnnp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-autores-7a8bb6-openshift-default-7f996bcbf5

SuccessfulCreate

Created pod: e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

openshift-ingress

multus

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

Created

Container created

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

Started

Container started

openshift-ingress

deployment-controller

e2e-autores-7a8bb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-7a8bb6-openshift-default-7f996bcbf5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-7a8bb6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a8bb6-bb857998c-k7vwl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-7a8bb6-7d87956497-89pr8

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

ProbeError

Startup probe error: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

Unhealthy

Startup probe failed: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-q5fc6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-7a8bb6-openshift-default-7f996bcbf5-bcbmg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-a-0f2e06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f

SuccessfulCreate

Created pod: e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-0f2e06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-0f2e06

openshift-ingress

multus

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

AddedInterface

Add eth0 [10.132.1.7/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dde84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dde84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-0f2e06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0f2e06: serviceaccount "payload-processing-e2e-extmod-a-0f2e06" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0f2e06: serviceaccount "payload-processing-e2e-extmod-a-0f2e06" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-0f2e06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

AddedInterface

Add eth0 [10.132.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-643355-openshift-default-77b8b64ffc

SuccessfulCreate

Created pod: e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-b-643355-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-643355-openshift-default-77b8b64ffc from 1 to 2

openshift-ingress

multus

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Unhealthy

Readiness probe failed: Get "http://10.133.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

ProbeError

Readiness probe error: Get "http://10.133.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dde84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2dde84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-71a41c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-71a41c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

Unhealthy

Startup probe failed: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

ProbeError

Startup probe error: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0f2e06-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0f2e06-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-2365fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-2365fa-openshift-default-d56cdc89c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-2365fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-2365fa

openshift-ingress

replicaset-controller

e2e-extmod-b-2365fa-openshift-default-d56cdc89c

SuccessfulCreate

Created pod: e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

openshift-ingress

multus

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2365fa-798d564587

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

AddedInterface

Add eth0 [10.132.1.13/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-2365fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-2365fa-798d564587

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-2365fa-798d564587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2365fa: serviceaccount "payload-processing-e2e-extmod-b-2365fa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-2365fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-2365fa-798d564587 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-2365fa: serviceaccount "payload-processing-e2e-extmod-b-2365fa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0f2e06-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0f2e06-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-643355-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-643355-openshift-default-77b8b64ffc from 2 to 3

openshift-ingress

replicaset-controller

e2e-extmod-b-643355-openshift-default-77b8b64ffc

SuccessfulCreate

Created pod: e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Unhealthy

Startup probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

ProbeError

Startup probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2365fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2365fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

Unhealthy

Startup probe failed: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

ProbeError

Startup probe error: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2365fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-2365fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-292kl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 3 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-v52mc

models-as-a-service

replicaset-controller

payload-processing-external-model-5649fd4f9b

SuccessfulCreate

Created pod: payload-processing-external-model-5649fd4f9b-jj5dj
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5649fd4f9b

FailedCreate

Error creating: pods "payload-processing-external-model-5649fd4f9b-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5649fd4f9b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5649fd4f9b-jj5dj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5649fd4f9b-jj5dj

AddedInterface

Add eth0 [10.133.0.236/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5649fd4f9b-jj5dj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5649fd4f9b-jj5dj

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5b845f4bcb from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5b845f4bcb

SuccessfulCreate

Created pod: payload-processing-external-model-5b845f4bcb-qx9t6

models-as-a-service

kubelet

payload-processing-external-model-5b845f4bcb-qx9t6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5b845f4bcb-qx9t6

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5b845f4bcb-qx9t6

AddedInterface

Add eth0 [10.132.1.50/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5b845f4bcb-qx9t6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5cf4bb9494-7n5wc

AddedInterface

Add eth0 [10.132.1.51/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5b845f4bcb

SuccessfulDelete

Deleted pod: payload-processing-external-model-5b845f4bcb-qx9t6

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-7n5wc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-5cf4bb9494

SuccessfulCreate

Created pod: payload-processing-external-model-5cf4bb9494-7n5wc

models-as-a-service

kubelet

payload-processing-external-model-5b845f4bcb-qx9t6

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-7n5wc

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-7n5wc

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5b845f4bcb from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5b8468948b

SuccessfulCreate

Created pod: payload-processing-external-model-5b8468948b-9l7j4

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5b8468948b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5cf4bb9494

SuccessfulDelete

Deleted pod: payload-processing-external-model-5cf4bb9494-7n5wc

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-7n5wc

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5b8468948b-9l7j4

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5b8468948b-9l7j4

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5b8468948b-9l7j4

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5b8468948b-9l7j4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5cf4bb9494 from 0 to 1

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5b8468948b from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5b8468948b

SuccessfulDelete

Deleted pod: payload-processing-external-model-5b8468948b-9l7j4

models-as-a-service

multus

payload-processing-external-model-5cf4bb9494-z68c2

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-z68c2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-z68c2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-z68c2

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-5cf4bb9494

SuccessfulCreate

Created pod: payload-processing-external-model-5cf4bb9494-z68c2

models-as-a-service

kubelet

payload-processing-external-model-5b8468948b-9l7j4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Killing

Stopping container istio-proxy

models-as-a-service

replicaset-controller

payload-processing-external-model-744487595b

SuccessfulCreate

Created pod: payload-processing-external-model-744487595b-p774w

models-as-a-service

kubelet

payload-processing-external-model-5cf4bb9494-z68c2

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-744487595b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5cf4bb9494

SuccessfulDelete

Deleted pod: payload-processing-external-model-5cf4bb9494-z68c2

models-as-a-service

multus

payload-processing-external-model-744487595b-p774w

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-744487595b-p774w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5cf4bb9494 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-744487595b-p774w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-ckx7l

models-as-a-service

kubelet

payload-processing-external-model-744487595b-p774w

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-jvnf9

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 3 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-lxxrh

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-dbtkz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

AddedInterface

Add eth0 [10.132.1.55/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

ProbeError

Startup probe error: Get "http://10.132.1.55:15021/healthz/ready": dial tcp 10.132.1.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

Unhealthy

Startup probe failed: Get "http://10.132.1.55:15021/healthz/ready": dial tcp 10.132.1.55:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

ProbeError

Startup probe error: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

Unhealthy

Startup probe failed: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5649fd4f9b from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5649fd4f9b-jj5dj

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5649fd4f9b

SuccessfulDelete

Deleted pod: payload-processing-external-model-5649fd4f9b-jj5dj

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 6 to 9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-f6dgq

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-m4rk6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-gsh6q

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

AddedInterface

Add eth0 [10.132.1.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Unhealthy

Startup probe failed: Get "http://10.132.1.58:15021/healthz/ready": dial tcp 10.132.1.58:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

ProbeError

Startup probe error: Get "http://10.132.1.58:15021/healthz/ready": dial tcp 10.132.1.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

ProbeError

Startup probe error: Get "http://10.132.1.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Unhealthy

Startup probe failed: Get "http://10.132.1.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 9 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-8qdvr

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

AddedInterface

Add eth0 [10.133.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-643355-openshift-default-77b8b64ffc

SuccessfulDelete

Deleted pod: e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-643355-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-643355-openshift-default-77b8b64ffc from 3 to 2

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-gmpb5

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

Unhealthy

Startup probe failed: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

ProbeError

Startup probe error: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled up replica set payload-processing-external-model-58ddf7f69 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-58ddf7f69-plx99

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-58ddf7f69

SuccessfulCreate

Created pod: payload-processing-external-model-58ddf7f69-plx99

models-as-a-service

kubelet

payload-processing-external-model-744487595b-p774w

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-external-model-dockercfg-l2lh7); attempting to pull the image may not succeed.

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

Killing

Stopping container payload-processing
(x4)

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-621795298e14" not found
(x4)

models-as-a-service

kubelet

payload-processing-external-model-58ddf7f69-plx99

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bc4454848 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc4454848

SuccessfulCreate

Created pod: payload-processing-external-model-5bc4454848-958cf
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc4454848

FailedCreate

Error creating: pods "payload-processing-external-model-5bc4454848-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-958cf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5bc4454848-958cf

AddedInterface

Add eth0 [10.132.1.62/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-958cf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-958cf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-958cf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-r5cvc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bc4454848 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc4454848

FailedCreate

Error creating: pods "payload-processing-external-model-5bc4454848-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc4454848

SuccessfulCreate

Created pod: payload-processing-external-model-5bc4454848-fs5kr

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-fs5kr

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5bc4454848-fs5kr

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-fs5kr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-fs5kr

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bc4454848-fs5kr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-inf-a-e271b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e271b1-openshift-default-7c7d6f858c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-e271b1-openshift-default-7c7d6f858c

SuccessfulCreate

Created pod: e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e271b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e271b1

openshift-ingress

multus

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

AddedInterface

Add eth0 [10.133.0.252/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e271b1: serviceaccount "payload-processing-e2e-inf-a-e271b1" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e271b1: serviceaccount "payload-processing-e2e-inf-a-e271b1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e271b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e271b1-6f87f7d6b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e271b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e271b1-865cd788c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

AddedInterface

Add eth0 [10.132.1.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e271b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e271b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-inf-a-c4489d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c4489d-openshift-default-74d45cccd7 from 0 to 1

openshift-ingress

multus

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

AddedInterface

Add eth0 [10.132.1.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c4489d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c4489d

openshift-ingress

replicaset-controller

e2e-inf-a-c4489d-openshift-default-74d45cccd7

SuccessfulCreate

Created pod: e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c4489d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c4489d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c4489d-7864c48c5c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

AddedInterface

Add eth0 [10.133.0.255/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c4489d-7864c48c5c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c4489d-7864c48c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c4489d: serviceaccount "payload-processing-e2e-inf-a-c4489d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c4489d-7864c48c5c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c4489d: serviceaccount "payload-processing-e2e-inf-a-c4489d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42

AddedInterface

Add eth0 [10.132.1.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

ProbeError

Startup probe error: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

Unhealthy

Startup probe failed: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-f765b8-openshift-default-d9b984d69

SuccessfulCreate

Created pod: e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

openshift-ingress

deployment-controller

e2e-inf-b-f765b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f765b8-openshift-default-d9b984d69 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f765b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f765b8

openshift-ingress

multus

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

AddedInterface

Add eth0 [10.132.1.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f765b8-6cdcf47d95

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f765b8-6cdcf47d95

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f765b8-6cdcf47d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f765b8: serviceaccount "payload-processing-e2e-inf-b-f765b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f765b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f765b8-6cdcf47d95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f765b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f765b8-d59ccb87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f765b8: serviceaccount "payload-processing-e2e-inf-b-f765b8" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

AddedInterface

Add eth0 [10.132.1.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

ProbeError

Readiness probe error: Get "http://10.132.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Unhealthy

Readiness probe failed: Get "http://10.132.1.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e271b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e271b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

ProbeError

Startup probe error: Get "http://10.132.1.71:15021/healthz/ready": dial tcp 10.132.1.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Unhealthy

Startup probe failed: Get "http://10.132.1.71:15021/healthz/ready": dial tcp 10.132.1.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-dfd6f0-openshift-default-5685858dbf

SuccessfulCreate

Created pod: e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

openshift-ingress

deployment-controller

e2e-inf-b-dfd6f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-dfd6f0-openshift-default-5685858dbf from 0 to 1

openshift-ingress

multus

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

AddedInterface

Add eth0 [10.132.1.96/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-dfd6f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-dfd6f0

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e6f4fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e6f4fe
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-dfd6f0: serviceaccount "payload-processing-e2e-inf-b-dfd6f0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-dfd6f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-dfd6f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-dfd6f0-6b55b96879 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-dfd6f0-6b55b96879

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-dfd6f0-6b55b96879

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-dfd6f0-6b55b96879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-dfd6f0: serviceaccount "payload-processing-e2e-inf-b-dfd6f0" not found

openshift-ingress

deployment-controller

e2e-inf-a-e6f4fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7

SuccessfulCreate

Created pod: e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m

Created

Container created

openshift-ingress

multus

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

AddedInterface

Add eth0 [10.132.1.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e6f4fe-785d685d77

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e6f4fe-785d685d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e6f4fe: serviceaccount "payload-processing-e2e-inf-a-e6f4fe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e6f4fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e6f4fe: serviceaccount "payload-processing-e2e-inf-a-e6f4fe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e6f4fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e6f4fe-785d685d77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e6f4fe-785d685d77

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

AddedInterface

Add eth0 [10.133.1.14/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-c4489d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-c4489d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e6f4fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e6f4fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-a-78ddbc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-78ddbc

openshift-ingress

deployment-controller

e2e-inf-a-78ddbc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-78ddbc-openshift-default-668df4d547 from 0 to 1

openshift-ingress

multus

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

AddedInterface

Add eth0 [10.133.1.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-78ddbc-openshift-default-668df4d547

SuccessfulCreate

Created pod: e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-78ddbc: serviceaccount "payload-processing-e2e-inf-a-78ddbc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-78ddbc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-78ddbc-db7449c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-78ddbc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-78ddbc-78c556dbb9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-78ddbc-78c556dbb9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-78ddbc-78c556dbb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-78ddbc: serviceaccount "payload-processing-e2e-inf-a-78ddbc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-78ddbc-78c556dbb9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

AddedInterface

Add eth0 [10.133.1.18/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

AddedInterface

Add eth0 [10.133.1.19/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

Unhealthy

Startup probe failed: Get "http://10.132.1.90:15021/healthz/ready": dial tcp 10.132.1.90:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

ProbeError

Startup probe error: Get "http://10.132.1.90:15021/healthz/ready": dial tcp 10.132.1.90:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-b72fa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b72fa3-openshift-default-7867f84765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-b72fa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b72fa3

openshift-ingress

replicaset-controller

e2e-inf-a-b72fa3-openshift-default-7867f84765

SuccessfulCreate

Created pod: e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

openshift-ingress

multus

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

AddedInterface

Add eth0 [10.132.1.106/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b72fa3: serviceaccount "payload-processing-e2e-inf-a-b72fa3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-b72fa3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-b72fa3-7895dcd6d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-b72fa3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b72fa3: serviceaccount "payload-processing-e2e-inf-a-b72fa3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f765b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f765b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

AddedInterface

Add eth0 [10.133.1.20/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

AddedInterface

Add eth0 [10.133.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f765b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f765b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

ProbeError

Readiness probe error: Get "http://10.132.1.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Unhealthy

Readiness probe failed: Get "http://10.132.1.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Unhealthy

Readiness probe failed: Get "http://10.132.1.97:15021/healthz/ready": dial tcp 10.132.1.97:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

ProbeError

Readiness probe error: Get "http://10.132.1.97:15021/healthz/ready": dial tcp 10.132.1.97:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Unhealthy

Startup probe failed: Get "http://10.132.1.96:15021/healthz/ready": dial tcp 10.132.1.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

ProbeError

Startup probe error: Get "http://10.132.1.96:15021/healthz/ready": dial tcp 10.132.1.96:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-dfd6f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

ProbeError

Startup probe error: Get "http://10.132.1.97:15021/healthz/ready": dial tcp 10.132.1.97:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-dfd6f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Unhealthy

Startup probe failed: Get "http://10.132.1.97:15021/healthz/ready": dial tcp 10.132.1.97:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-dfd6f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-dfd6f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ba44ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ba44ed

openshift-ingress

replicaset-controller

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f

SuccessfulCreate

Created pod: e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

openshift-ingress

deployment-controller

e2e-inf-b-ba44ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ba44ed-openshift-default-69b4f8b76f from 0 to 1

openshift-ingress

multus

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

AddedInterface

Add eth0 [10.132.1.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ba44ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ba44ed: serviceaccount "payload-processing-e2e-inf-b-ba44ed" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ba44ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ba44ed: serviceaccount "payload-processing-e2e-inf-b-ba44ed" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht

AddedInterface

Add eth0 [10.132.1.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

AddedInterface

Add eth0 [10.132.1.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 10 to 9
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e6f4fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-ckx7l
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e6f4fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-ckx7l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78ddbc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

ProbeError

Startup probe error: Get "http://10.133.1.17:15021/healthz/ready": dial tcp 10.133.1.17:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78ddbc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Unhealthy

Startup probe failed: Get "http://10.133.1.17:15021/healthz/ready": dial tcp 10.133.1.17:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba44ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba44ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78ddbc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-78ddbc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-d042a8-openshift-default-56bb565455

SuccessfulCreate

Created pod: e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

openshift-ingress

deployment-controller

e2e-inf-b-d042a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d042a8-openshift-default-56bb565455 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d042a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d042a8

openshift-ingress

multus

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

AddedInterface

Add eth0 [10.133.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Unhealthy

Readiness probe failed: Get "http://10.132.1.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

ProbeError

Readiness probe error: Get "http://10.132.1.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d042a8-7b4d8869f7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d042a8-7b4d8869f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d042a8: serviceaccount "payload-processing-e2e-inf-b-d042a8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d042a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d042a8-7b4d8869f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d042a8-7b4d8869f7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d042a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb
(x2)

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d042a8: serviceaccount "payload-processing-e2e-inf-b-d042a8" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

AddedInterface

Add eth0 [10.132.1.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

AddedInterface

Add eth0 [10.133.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Unhealthy

Startup probe failed: Get "http://10.132.1.106:15021/healthz/ready": dial tcp 10.132.1.106:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

ProbeError

Startup probe error: Get "http://10.132.1.106:15021/healthz/ready": dial tcp 10.132.1.106:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b72fa3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b72fa3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-b-eb6010-openshift-default-787f9bd597

SuccessfulCreate

Created pod: e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

openshift-ingress

deployment-controller

e2e-inf-b-eb6010-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-eb6010-openshift-default-787f9bd597 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-eb6010

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-eb6010

openshift-ingress

multus

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

AddedInterface

Add eth0 [10.132.1.111/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-eb6010: serviceaccount "payload-processing-e2e-inf-b-eb6010" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-eb6010

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-eb6010-576fcf969f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-eb6010

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-eb6010-59f8cf7dd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-eb6010: serviceaccount "payload-processing-e2e-inf-b-eb6010" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

AddedInterface

Add eth0 [10.133.1.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b72fa3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b72fa3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-jvnf9
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-f6dgq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-f6dgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jvnf9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 9 to 7
(x6)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

ProbeError

Startup probe error: Get "http://10.132.1.107:15021/healthz/ready": dial tcp 10.132.1.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Unhealthy

Startup probe failed: Get "http://10.132.1.107:15021/healthz/ready": dial tcp 10.132.1.107:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba44ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba44ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-eb6010-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-eb6010-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

ProbeError

Readiness probe error: Get "http://10.133.1.24:15021/healthz/ready": dial tcp 10.133.1.24:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Unhealthy

Readiness probe failed: Get "http://10.133.1.24:15021/healthz/ready": dial tcp 10.133.1.24:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

ProbeError

Startup probe error: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Unhealthy

Startup probe failed: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Unhealthy

Startup probe failed: Get "http://10.133.1.24:15021/healthz/ready": dial tcp 10.133.1.24:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

ProbeError

Startup probe error: Get "http://10.133.1.24:15021/healthz/ready": dial tcp 10.133.1.24:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d042a8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d042a8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-eb6010-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-eb6010-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-d042a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d042a8-openshift-default-56bb565455 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-d042a8-openshift-default-56bb565455

SuccessfulCreate

Created pod: e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

Created

Container created

openshift-ingress

multus

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

AddedInterface

Add eth0 [10.132.1.113/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-d042a8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-ba44ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ba44ed-openshift-default-69b4f8b76f from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f

SuccessfulCreate

Created pod: e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-ba44ed-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

AddedInterface

Add eth0 [10.133.1.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

Unhealthy

Startup probe failed: Get "http://10.132.1.113:15021/healthz/ready": dial tcp 10.132.1.113:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

ProbeError

Startup probe error: Get "http://10.132.1.113:15021/healthz/ready": dial tcp 10.132.1.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Unhealthy

Startup probe failed: Get "http://10.133.1.30:15021/healthz/ready": dial tcp 10.133.1.30:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-6929a4-openshift-default-6c5447865

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-6929a4-openshift-default-6c5447865-rpnk5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-6929a4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

ProbeError

Startup probe error: Get "http://10.133.1.30:15021/healthz/ready": dial tcp 10.133.1.30:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w1-6929a4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-6929a4-openshift-default-6c5447865 from 2 to 1
(x8)

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 2 to 1
(x5)

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-t89kn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-3575b9-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w0-3575b9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7 from 2 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulDelete

Deleted pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-8kbcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5dpsl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67

SuccessfulDelete

Deleted pod: e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-0fbc17-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-0fbc17-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gsh6q

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 7 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-8qdvr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-gsh6q

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-xvt47

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-8qdvr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulDelete

Deleted pod: e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-qnwgv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df

SuccessfulDelete

Deleted pod: e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7e7a83-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-7e7a83-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-7e7a83-openshift-default-6cdc8484df from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-rjj92

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-643355-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-643355-openshift-default-77b8b64ffc from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-643355-openshift-default-77b8b64ffc

SuccessfulDelete

Deleted pod: e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-643355-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

Unhealthy

Readiness probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-fr8zq

ProbeError

Readiness probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e271b1-865cd788c5-c4gvq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e271b1-6f87f7d6b9-8gnlp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-e271b1-openshift-default-7c7d6f858c-kjmt6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4489d-7864c48c5c-hhd42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-f765b8-openshift-default-d9b984d69-4ncc6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4489d-6745f7b5d7-h8gxw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f765b8-6cdcf47d95-jsgjx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f765b8-d59ccb87-t5g7j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-lxxrh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-lxxrh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-c4489d-openshift-default-74d45cccd7-zs9q6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-dfd6f0-6b55b96879-6dp5m

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-dfd6f0-998f7d5d7-vprg4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-n97lr

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-jxxsm

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

AddedInterface

Add eth0 [10.133.1.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-hf7z5

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-n97lr

AddedInterface

Add eth0 [10.133.1.32/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-n97lr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-n97lr

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

AddedInterface

Add eth0 [10.132.1.118/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-n97lr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-r2tbm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-dfd6f0-openshift-default-5685858dbf-ft9xf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

Unhealthy

Startup probe failed: Get "http://10.133.1.31:15021/healthz/ready": dial tcp 10.133.1.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

ProbeError

Startup probe error: Get "http://10.133.1.31:15021/healthz/ready": dial tcp 10.133.1.31:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

Unhealthy

Startup probe failed: Get "http://10.132.1.118:15021/healthz/ready": dial tcp 10.132.1.118:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

ProbeError

Startup probe error: Get "http://10.132.1.118:15021/healthz/ready": dial tcp 10.132.1.118:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-n97lr

Unhealthy

Startup probe failed: Get "http://10.133.1.32:15021/healthz/ready": dial tcp 10.133.1.32:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-n97lr

ProbeError

Startup probe error: Get "http://10.133.1.32:15021/healthz/ready": dial tcp 10.133.1.32:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-gppb5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-cf7zm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-gppb5

AddedInterface

Add eth0 [10.133.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gppb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gppb5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gppb5

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gppb5

Unhealthy

Startup probe failed: Get "http://10.133.1.33:15021/healthz/ready": dial tcp 10.133.1.33:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gppb5

ProbeError

Startup probe error: Get "http://10.133.1.33:15021/healthz/ready": dial tcp 10.133.1.33:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e6f4fe-785d685d77-w4vw7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78ddbc-78c556dbb9-mw6gs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e6f4fe-65b98ddccf-sxwhx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78ddbc-db7449c5-v848b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-78ddbc-openshift-default-668df4d547-q8gsj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-z89sk

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z89sk

Killing

Stopping container discovery

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d042a8-7b4d8869f7-v6fw8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-e6f4fe-openshift-default-6cfbbc7bb7-rlv7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ba44ed-5d5db5f6ff-pbpht

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d042a8-7d6f4dd8ff-nv6fb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-kmcv2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b72fa3-7895dcd6d7-pb4v8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

AddedInterface

Add eth0 [10.133.1.34/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b72fa3-b745c9fc5-fn856

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ba44ed-65d95b88d7-5tn8z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-b72fa3-openshift-default-7867f84765-4ldbm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-kngvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-d042a8-openshift-default-56bb565455-nkcxn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-4b85d50c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4b85d50c

openshift-ingress

replicaset-controller

e2e-mt-4b85d50c-openshift-default-558d957877

SuccessfulCreate

Created pod: e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

openshift-ingress

multus

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

AddedInterface

Add eth0 [10.133.1.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-4b85d50c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4b85d50c-openshift-default-558d957877 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4b85d50c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4b85d50c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4b85d50c-84b44fb699 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

AddedInterface

Add eth0 [10.133.1.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4b85d50c: serviceaccount "payload-processing-e2e-mt-4b85d50c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4b85d50c: serviceaccount "payload-processing-e2e-mt-4b85d50c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

openshift-ingress

multus

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk

AddedInterface

Add eth0 [10.133.1.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-2wltl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-ba44ed-openshift-default-69b4f8b76f-pdj47

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-eb6010-59f8cf7dd7-pj4g2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-eb6010-576fcf969f-jm79f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-eb6010-openshift-default-787f9bd597-hgrvs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-736f7c-b8cfc9767-k49mb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-736f7c-b6945b94c-wxz8r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

Unhealthy

Startup probe failed: Get "http://10.133.1.35:15021/healthz/ready": dial tcp 10.133.1.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

ProbeError

Startup probe error: Get "http://10.133.1.35:15021/healthz/ready": dial tcp 10.133.1.35:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-736f7c-openshift-default-56685bb6d5-gwn2z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2dde84-5d85974555-4pg98

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2dde84-6c4f95c467-pj9ss

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4b85d50c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4b85d50c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0f2e06-7d4d8cfcd7-srrv4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0f2e06-7dbbfc6cd9-h72zq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-2dde84-openshift-default-799f6d654f-fw5c4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-0f2e06-openshift-default-8d5cccd8f-2j7ms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-32ea65-945f7c88c-bf9kt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-32ea65-798cd6f665-l6xzp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-2365fa-798d564587-vkrp8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-2365fa-7f5b898d87-f95rk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-mt-4b85d50c-5ccbc9dfd5-8gb8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4b85d50c-84b44fb699-nh9kk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-32ea65-openshift-default-595544d6dc-7dsfb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-2365fa-openshift-default-d56cdc89c-h2x89

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df

SuccessfulCreate

Created pod: e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

openshift-ingress

deployment-controller

e2e-shared-a-w2-3d8293-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-3d8293-openshift-default-6d79f978df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-3d8293

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-3d8293

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

AddedInterface

Add eth0 [10.132.1.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4b85d50c-openshift-default-558d957877-z2knj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-3575b9-7d86dfd575-rdtf8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-3d8293

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-3d8293

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f from 0 to 1
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-3575b9-7fd5656bb5-vldtj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3d8293: serviceaccount "payload-processing-e2e-shared-a-w2-3d8293" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3d8293: serviceaccount "payload-processing-e2e-shared-a-w2-3d8293" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

AddedInterface

Add eth0 [10.133.1.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

AddedInterface

Add eth0 [10.133.1.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e4c131-57f569c5cc-7q57f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e4c131-5c4fdcdc59-x24p5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-3575b9-openshift-default-6d68fdfcb7-dpd25

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-e4c131-openshift-default-6bfc86fbcf-k8rq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-6929a4-6fcb8c55bc-cz97t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-6929a4-6f857bbb47-mh7pl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-6929a4-openshift-default-6c5447865-98zdc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0fbc17-849c8fb697-82cv5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0fbc17-69fd8fbf59-r54s4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-0fbc17-openshift-default-5c4c87fd67-qz8r4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a44352

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a44352

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c

SuccessfulCreate

Created pod: e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

openshift-ingress

deployment-controller

e2e-shared-b-w2-a44352-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a44352-openshift-default-5955f6c46c from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

AddedInterface

Add eth0 [10.133.1.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Unhealthy

Readiness probe failed: Get "http://10.132.1.143:15021/healthz/ready": read tcp 10.132.0.2:34778->10.132.1.143:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

ProbeError

Readiness probe error: Get "http://10.132.1.143:15021/healthz/ready": read tcp 10.132.0.2:34778->10.132.1.143:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a44352-79f898dd97

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a44352

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a44352-79f898dd97

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a44352-79f898dd97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a44352: serviceaccount "payload-processing-e2e-shared-b-w2-a44352" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a44352: serviceaccount "payload-processing-e2e-shared-b-w2-a44352" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a44352

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a44352-79f898dd97 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

AddedInterface

Add eth0 [10.133.1.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

AddedInterface

Add eth0 [10.133.1.51/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Unhealthy

Startup probe failed: Get "http://10.132.1.143:15021/healthz/ready": dial tcp 10.132.1.143:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

ProbeError

Startup probe error: Get "http://10.132.1.143:15021/healthz/ready": dial tcp 10.132.1.143:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7e7a83-954cf6f9-lpxhs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7e7a83-7d4bbb4cff-4w5dd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-3d8293-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-3d8293-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-7e7a83-openshift-default-6cdc8484df-dxchv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-3d8293-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-3d8293-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-a44352-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-a44352-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

Unhealthy

Startup probe failed: Get "http://10.133.1.50:15021/healthz/ready": dial tcp 10.133.1.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

ProbeError

Startup probe error: Get "http://10.133.1.50:15021/healthz/ready": dial tcp 10.133.1.50:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-a44352-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-a44352-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7361-6fc1fa

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7361-6fc1fa

AddedInterface

Add eth0 [10.133.1.54/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-6fc1fa

Started

Container started

opendatahub

kubelet

test-curl-7361-6fc1fa

Created

Container created

opendatahub

kubelet

test-curl-7361-8b5248

Created

Container created

opendatahub

kubelet

test-curl-7361-6fc1fa

Killing

Stopping container test-curl-7361-6fc1fa

opendatahub

kubelet

test-curl-7361-8b5248

Started

Container started

opendatahub

kubelet

test-curl-7361-8b5248

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7361-8b5248

AddedInterface

Add eth0 [10.133.1.55/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7361-8b5248

Killing

Stopping container test-curl-7361-8b5248

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-696c7a-openshift-default-67695fc869-j578j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-696c7a-d6965f547-wh87f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-696c7a-787b4845b7-dqvxv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-hf7z5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-gppb5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7f5667f86c-gppb5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-n97lr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hf7z5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hm547

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-643355-75b78974f7-6t2rg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-643355-77d866896c-wwn2l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c712b1-6c465d59f9-ctsxc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-643355-openshift-default-77b8b64ffc-wddxz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c712b1-f8c68f96c-jwpdb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-c712b1-openshift-default-565f6f489-92kfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-12df3c-8f7c97f8f-wgk2p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-12df3c-69559b4d55-tx9t8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-12df3c-openshift-default-6dd7fc4b59-h8whd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-bb4907-fb7c6c5cc-vttnb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-bb4907-6c88cfdd4c-vjrcz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-bb4907-openshift-default-5d449c9f5c-lj5vc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-3d8293-openshift-default-6d79f978df-7g5q4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-56bbb6-openshift-default-775f4bf5c-2kwtd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9877ce-6fc6c4dccf-wmxzc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9877ce-6f64cd4bff-tfpwl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-56bbb6-548f5c74cf-xdt7h

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.213:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-56bbb6-757d5dfd7-t7mgw

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.212:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-354660-58c847bbf7-hgzfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-354660-59855fc979-s2v7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w4-9877ce-openshift-default-68479d46df-2f96z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-a44352-openshift-default-5955f6c46c-tss8n

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d8293-67c9869b9f-fkbsx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d8293-57c89ff647-q8t6w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-7f19e8-openshift-default-67fbc85cc-9lz8z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a44352-79f898dd97-h6vbb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a44352-67db99b575-h8vcc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-ea9556-openshift-default-767c695d45-zhtt9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-354660-openshift-default-79d5658cf

SuccessfulCreate

Created pod: e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

openshift-ingress

multus

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

AddedInterface

Add eth0 [10.133.1.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-354660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-354660-openshift-default-79d5658cf from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-354660-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7f19e8-8595d55f79-f6dd4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7f19e8-548b74dc8c-wrxq2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ea9556-7df86d994f-dsdxk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ea9556-6d7cb9c4bc-kzcmk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

ProbeError

Startup probe error: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

Unhealthy

Startup probe failed: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-5qnjx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-354660-openshift-default-79d5658cf-d9669

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-71a41c-openshift-default-668c99ff8f-lnczp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-71a41c-5dcfbbccbc-q559z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-71a41c-64d6f8f7bc-mf5fv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-9db802-744b4d58c-r6rw4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-kmcv2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kmcv2

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7f5667f86c from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-r2tbm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-9db802-544bb54dbf-jvw99

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.70:50052" within 1s: context deadline exceeded

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

AddedInterface

Add eth0 [10.133.1.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-9db802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-9db802-openshift-default-bd9c7b99f from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-9db802-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-9db802-openshift-default-bd9c7b99f

SuccessfulCreate

Created pod: e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

Started

Container started

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

AddedInterface

Add eth0 [10.133.1.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

Created

Container created

openshift-ingress

multus

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

AddedInterface

Add eth0 [10.132.1.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

Unhealthy

Startup probe failed: Get "http://10.133.1.58:15021/healthz/ready": dial tcp 10.133.1.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

Unhealthy

Startup probe failed: Get "http://10.133.1.57:15021/healthz/ready": dial tcp 10.133.1.57:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-bzsf6

ProbeError

Startup probe error: Get "http://10.133.1.57:15021/healthz/ready": dial tcp 10.133.1.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

Unhealthy

Startup probe failed: Get "http://10.132.1.166:15021/healthz/ready": dial tcp 10.132.1.166:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

ProbeError

Startup probe error: Get "http://10.133.1.58:15021/healthz/ready": dial tcp 10.133.1.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-nr52p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-5plz8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-worker-w4-9db802-openshift-default-bd9c7b99f-zzh9k

ProbeError

Startup probe error: Get "http://10.132.1.166:15021/healthz/ready": dial tcp 10.132.1.166:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-337764-openshift-default-555d885b9

SuccessfulCreate

Created pod: e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-337764-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-337764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-337764-openshift-default-555d885b9 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

AddedInterface

Add eth0 [10.133.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-337764-5fbd7f5d59-chd2w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-337764-79b874659f-8bjsl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

ProbeError

Startup probe error: Get "http://10.133.1.59:15021/healthz/ready": dial tcp 10.133.1.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

Unhealthy

Startup probe failed: Get "http://10.133.1.59:15021/healthz/ready": dial tcp 10.133.1.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-ltkqn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-337764-openshift-default-555d885b9-b9wp6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

AddedInterface

Add eth0 [10.133.1.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-466229b7-openshift-default-85b7688cd5

SuccessfulCreate

Created pod: e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

openshift-ingress

gateway_labeler_controller

e2e-ait-466229b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-466229b7

openshift-ingress

deployment-controller

e2e-ait-466229b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-466229b7-openshift-default-85b7688cd5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-466229b7-747d765b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-466229b7-757d899967

FailedCreate

Error creating: pods "payload-processing-e2e-ait-466229b7-757d899967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-466229b7: serviceaccount "payload-processing-e2e-ait-466229b7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-466229b7-747d765b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-466229b7-747d765b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-466229b7: serviceaccount "payload-processing-e2e-ait-466229b7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-466229b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-466229b7-747d765b4c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-466229b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-466229b7-757d899967 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-466229b7-757d899967-mqk4x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-466229b7-757d899967-mqk4x

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-466229b7-757d899967

SuccessfulCreate

Created pod: payload-processing-e2e-ait-466229b7-757d899967-mqk4x

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj

AddedInterface

Add eth0 [10.133.1.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-466229b7-757d899967-mqk4x

AddedInterface

Add eth0 [10.133.1.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-466229b7-757d899967-mqk4x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

ProbeError

Readiness probe error: Get "http://10.133.1.60:15021/healthz/ready": read tcp 10.133.0.2:35852->10.133.1.60:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Created

Container created

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Unhealthy

Readiness probe failed: Get "http://10.133.1.60:15021/healthz/ready": read tcp 10.133.0.2:35852->10.133.1.60:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

ProbeError

Startup probe error: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Unhealthy

Startup probe failed: Get "http://10.133.1.60:15021/healthz/ready": dial tcp 10.133.1.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-466229b7-747d765b4c-p2flj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-466229b7-757d899967-mqk4x

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-466229b7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-466229b7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Killing

Stopping container istio-proxy

opendatahub

replicaset-controller

maas-controller-5f6b5c786d

SuccessfulDelete

Deleted pod: maas-controller-5f6b5c786d-jb7pn

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-466229b7-openshift-default-85b7688cd5-4k67f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

maas-controller-5f6b5c786d-jb7pn

Killing

Stopping container manager

opendatahub

multus

maas-controller-5f6b5c786d-hmrvb

AddedInterface

Add eth0 [10.133.1.64/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5f6b5c786d-hmrvb

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a"

opendatahub

replicaset-controller

maas-controller-5f6b5c786d

SuccessfulCreate

Created pod: maas-controller-5f6b5c786d-hmrvb

opendatahub

kubelet

maas-controller-5f6b5c786d-hmrvb

Started

Container started

opendatahub

kubelet

maas-controller-5f6b5c786d-hmrvb

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a" in 466ms (466ms including waiting). Image size: 200096244 bytes.

opendatahub

kubelet

maas-controller-5f6b5c786d-hmrvb

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7f5667f86c from 5 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7f5667f86c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7f5667f86c-wgbb7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

AddedInterface

Add eth0 [10.133.1.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-htjfk

AddedInterface

Add eth0 [10.133.1.68/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

AddedInterface

Add eth0 [10.133.1.66/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-66v28

AddedInterface

Add eth0 [10.133.1.67/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

maas-controller-5f6b5c786d-hmrvb_213442c6-01ff-4f2e-a0ca-f1f14a413ab3

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5f6b5c786d-hmrvb_213442c6-01ff-4f2e-a0ca-f1f14a413ab3 became leader
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

ProbeError

Startup probe error: Get "http://10.133.1.65:15021/healthz/ready": dial tcp 10.133.1.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Unhealthy

Startup probe failed: Get "http://10.133.1.68:15021/healthz/ready": dial tcp 10.133.1.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Unhealthy

Startup probe failed: Get "http://10.133.1.66:15021/healthz/ready": dial tcp 10.133.1.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

Unhealthy

Startup probe failed: Get "http://10.133.1.67:15021/healthz/ready": dial tcp 10.133.1.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

ProbeError

Startup probe error: Get "http://10.133.1.66:15021/healthz/ready": dial tcp 10.133.1.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

ProbeError

Startup probe error: Get "http://10.133.1.67:15021/healthz/ready": dial tcp 10.133.1.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

ProbeError

Startup probe error: Get "http://10.133.1.68:15021/healthz/ready": dial tcp 10.133.1.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Unhealthy

Startup probe failed: Get "http://10.133.1.65:15021/healthz/ready": dial tcp 10.133.1.65:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

Unhealthy

Startup probe failed: Get "http://10.133.1.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Unhealthy

Startup probe failed: Get "http://10.133.1.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

ProbeError

Startup probe error: Get "http://10.133.1.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

ProbeError

Startup probe error: Get "http://10.133.1.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Unhealthy

Startup probe failed: Get "http://10.133.1.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Unhealthy

Startup probe failed: Get "http://10.133.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

ProbeError

Startup probe error: Get "http://10.133.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

ProbeError

Startup probe error: Get "http://10.133.1.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5f6b5c786d from 1 to 0

opendatahub

kubelet

maas-controller-5f6b5c786d-hmrvb

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-5f6b5c786d

SuccessfulDelete

Deleted pod: maas-controller-5f6b5c786d-hmrvb

opendatahub

replicaset-controller

maas-controller-5f6b5c786d

SuccessfulCreate

Created pod: maas-controller-5f6b5c786d-z74vw
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5f6b5c786d from 0 to 1

opendatahub

kubelet

maas-controller-5f6b5c786d-z74vw

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a"

opendatahub

multus

maas-controller-5f6b5c786d-z74vw

AddedInterface

Add eth0 [10.133.1.69/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5f6b5c786d-z74vw

Started

Container started

opendatahub

kubelet

maas-controller-5f6b5c786d-z74vw

Created

Container created

opendatahub

kubelet

maas-controller-5f6b5c786d-z74vw

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:c853f8b9ad525624bcea2f7353263373f8992086e254e407fc162ef3faf0593a" in 432ms (432ms including waiting). Image size: 200096244 bytes.

opendatahub

maas-controller-5f6b5c786d-z74vw_282cc394-36f4-4318-be2c-13585c56522c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5f6b5c786d-z74vw_282cc394-36f4-4318-be2c-13585c56522c became leader

llm

replicaset-controller

e2e-prio-pool-5b37c7ac-kserve-78f764db84

SuccessfulCreate

Created pod: e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.ServiceAccount llm/e2e-prio-pool-5b37c7ac-epp-sa

llm

deployment-controller

e2e-prio-pool-5b37c7ac-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-5b37c7ac-kserve-78f764db84 from 0 to 1

llm

replicaset-controller

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55

SuccessfulCreate

Created pod: e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.Service llm/e2e-prio-pool-5b37c7ac-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.Deployment llm/e2e-prio-pool-5b37c7ac-kserve-router-scheduler

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.RoleBinding llm/e2e-prio-pool-5b37c7ac-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.Role llm/e2e-prio-pool-5b37c7ac-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.Service llm/e2e-prio-pool-5b37c7ac-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.Secret llm/e2e-prio-pool-5b37c7ac-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.Deployment llm/e2e-prio-pool-5b37c7ac-kserve

llm

multus

e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

AddedInterface

Add eth0 [10.133.1.70/23] from ovn-kubernetes

llm

deployment-controller

e2e-prio-pool-5b37c7ac-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-5b37c7ac-epp-auth-rb

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

Created

Container created

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

Started

Container started

llm

multus

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

AddedInterface

Add eth0 [10.133.1.71/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Started

Container started

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.368s (1.368s including waiting). Image size: 184206420 bytes.

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Created

Container created
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-5b37c7ac-kserve-shadow-svc

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Updated

Updated v1.Secret llm/e2e-prio-pool-5b37c7ac-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-5b37c7ac-kserve-route

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-5b37c7ac] is Ready

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Killing

Stopping container main

llm

LLMInferenceServiceController

e2e-prio-pool-5b37c7ac

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-5b37c7ac-epp-auth-rb

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-78f764db84-2rjx5

Killing

Stopping container main

openshift-ingress

deployment-controller

e2e-worker-single-main-1b623b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-1b623b-openshift-default-55946d8765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-1b623b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-1b623b

openshift-ingress

replicaset-controller

e2e-worker-single-main-1b623b-openshift-default-55946d8765

SuccessfulCreate

Created pod: e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

openshift-ingress

multus

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

AddedInterface

Add eth0 [10.132.1.167/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-1b623b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-1b623b: serviceaccount "payload-processing-e2e-worker-single-main-1b623b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-1b623b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-1b623b-c5bc974b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-1b623b-c5bc974b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-1b623b: serviceaccount "payload-processing-e2e-worker-single-main-1b623b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

AddedInterface

Add eth0 [10.132.1.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

openshift-ingress

multus

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

AddedInterface

Add eth0 [10.132.1.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

ProbeError

Readiness probe error: Get "http://10.132.1.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Unhealthy

Readiness probe failed: Get "http://10.132.1.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

ProbeError

Startup probe error: Get "http://10.132.1.167:15021/healthz/ready": dial tcp 10.132.1.167:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Unhealthy

Startup probe failed: Get "http://10.132.1.167:15021/healthz/ready": dial tcp 10.132.1.167:15021: connect: connection refused
(x5)

llm

kubelet

e2e-prio-pool-5b37c7ac-kserve-router-scheduler-56444cbb55-fdrmh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-1b623b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-1b623b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7984m8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8997pv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-1b623b-c5bc974b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-1b623b: serviceaccount "payload-processing-e2e-worker-single-main-1b623b" not found

openshift-ingress

multus

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

AddedInterface

Add eth0 [10.133.1.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

AddedInterface

Add eth0 [10.133.1.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-1b623b: serviceaccount "payload-processing-e2e-worker-single-main-1b623b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-1b623b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-1b623b-85fb875c7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-1b623b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-1b623b-c5bc974b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-1b623b-85fb8mfm58

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-1b623b-c5bc974b7zxsj7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-1b623b-openshift-default-55946d8765cz8kf

Killing

Stopping container istio-proxy

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.Secret llm/e2e-same-id-a-e7cd98d7-kserve-self-signed-certs

llm

kubelet

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-e7cd98d7-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.HTTPRoute llm/e2e-same-id-a-e7cd98d7-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.DestinationRule llm/e2e-same-id-a-e7cd98d7-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.Deployment llm/e2e-same-id-a-e7cd98d7-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.PodMonitor llm/e2e-same-id-a-e7cd98d7-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.PodMonitor llm/e2e-same-id-a-e7cd98d7-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Created

Created v1.Service llm/e2e-same-id-a-e7cd98d7-kserve-workload-svc

llm

deployment-controller

e2e-same-id-a-e7cd98d7-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-e7cd98d7-kserve-d84c5cb65 from 0 to 1

llm

replicaset-controller

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65

SuccessfulCreate

Created pod: e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

llm

multus

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

AddedInterface

Add eth0 [10.133.1.75/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

Created

Container created

llm

kubelet

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

Updated

Updated v1.Secret llm/e2e-same-id-a-e7cd98d7-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-e7cd98d7] is Ready

llm

deployment-controller

e2e-same-id-b-e7cd98d7-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-e7cd98d7-prometheus-scraping

llm

replicaset-controller

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7

SuccessfulCreate

Created pod: e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.HTTPRoute llm/e2e-same-id-b-e7cd98d7-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.DestinationRule llm/e2e-same-id-b-e7cd98d7-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.PodMonitor llm/e2e-same-id-b-e7cd98d7-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.PodMonitor llm/e2e-same-id-b-e7cd98d7-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.Secret llm/e2e-same-id-b-e7cd98d7-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.Deployment llm/e2e-same-id-b-e7cd98d7-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Created

Created v1.Service llm/e2e-same-id-b-e7cd98d7-kserve-workload-svc

llm

multus

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

AddedInterface

Add eth0 [10.133.1.76/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

Created

Container created

llm

kubelet

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

Unhealthy

Readiness probe failed: Get "http://10.132.1.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jxxsm

ProbeError

Readiness probe error: Get "http://10.132.1.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-e7cd98d7] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

Updated

Updated v1.Secret llm/e2e-same-id-b-e7cd98d7-kserve-self-signed-certs
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-e7cd98d7

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-e7cd98d7 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-e7cd98d7; safe to ignore if traffic splitting is planned
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-e7cd98d7

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-e7cd98d7 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-e7cd98d7; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-e7cd98d7-kserve-d84c5cb65-gvqhw

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-e7cd98d7-kserve-67f7cd47c7-h8m6b

Killing

Stopping container main
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

Unhealthy

Readiness probe failed: Get "http://10.134.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-hkc5n

ProbeError

Readiness probe error: Get "http://10.134.0.153:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-676c644999-plhvd

Created

Container created

openshift-ingress

multus

payload-pre-processing-676c644999-plhvd

AddedInterface

Add eth0 [10.133.1.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-676c644999 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-676c644999-plhvd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-676c644999-plhvd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-676c644999

SuccessfulCreate

Created pod: payload-pre-processing-676c644999-plhvd

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6dzmc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-6dzmc

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-6bd774d7c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-6bd774d7c8

SuccessfulCreate

Created pod: payload-processing-6bd774d7c8-qp8jq

openshift-ingress

multus

payload-processing-6bd774d7c8-qp8jq

AddedInterface

Add eth0 [10.133.1.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-6bd774d7c8-qp8jq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-6bd774d7c8-qp8jq

Created

Container created

openshift-ingress

kubelet

payload-processing-6bd774d7c8-qp8jq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6dzmc

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.32:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-pwdh9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-pwdh9

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

kubelet

payload-processing-6d9486d65f-f62bl

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-6fcc67b9b4

SuccessfulCreate

Created pod: payload-pre-processing-6fcc67b9b4-qld9t

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6fcc67b9b4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-6fcc67b9b4-qld9t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-6fcc67b9b4-qld9t

Created

Container created

openshift-ingress

multus

payload-processing-6d9486d65f-f62bl

AddedInterface

Add eth0 [10.133.1.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-6d9486d65f-f62bl

Created

Container created

openshift-ingress

kubelet

payload-processing-6d9486d65f-f62bl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-6fcc67b9b4-qld9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-6fcc67b9b4-qld9t

AddedInterface

Add eth0 [10.133.1.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-6d9486d65f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-6d9486d65f

SuccessfulCreate

Created pod: payload-processing-6d9486d65f-f62bl

openshift-ingress

replicaset-controller

payload-processing-6bd774d7c8

SuccessfulDelete

Deleted pod: payload-processing-6bd774d7c8-qp8jq

openshift-ingress

replicaset-controller

payload-pre-processing-676c644999

SuccessfulDelete

Deleted pod: payload-pre-processing-676c644999-plhvd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-6bd774d7c8 from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-676c644999 from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-676c644999-plhvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-6bd774d7c8-qp8jq

Killing

Stopping container payload-processing
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-78tsw

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-5bcd7997-78tsw

AddedInterface

Add eth0 [10.133.1.81/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-78tsw

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-78tsw

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-78tsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-78tsw

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9

SuccessfulCreate

Created pod: e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-5c7145

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-5c7145

openshift-ingress

deployment-controller

e2e-worker-single-main-5c7145-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9 from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

AddedInterface

Add eth0 [10.133.1.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-5c7145

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5c7145: serviceaccount "payload-processing-e2e-worker-single-main-5c7145" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5c7145: serviceaccount "payload-processing-e2e-worker-single-main-5c7145" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-5c7145

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

AddedInterface

Add eth0 [10.133.1.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

AddedInterface

Add eth0 [10.133.1.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

ProbeError

Startup probe error: Get "http://10.133.1.82:15021/healthz/ready": dial tcp 10.133.1.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

Unhealthy

Startup probe failed: Get "http://10.133.1.82:15021/healthz/ready": dial tcp 10.133.1.82:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5c7145-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5c7145-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5c7145-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-5c7145-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695j7bp9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdvmpxf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-5c7145

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-5c7145

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5c7145: serviceaccount "payload-processing-e2e-worker-single-main-5c7145" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-5c7145-5c69565755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-5c7145: serviceaccount "payload-processing-e2e-worker-single-main-5c7145" not found

openshift-ingress

multus

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

AddedInterface

Add eth0 [10.133.1.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-5c7145-7bd8885bd9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

AddedInterface

Add eth0 [10.133.1.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-5c7145-5c695qrts8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-5c7145-7bd8885bdkrw5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-5c7145-openshift-default-5bbcf8cb9-tpg8m

Killing

Stopping container istio-proxy

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-br6sk

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-br6sk
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w95pb

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-w95pb

AddedInterface

Add eth0 [10.132.1.171/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-w95pb
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w95pb

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-w95pb

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-w95pb_e3fc4c59-9814-4394-85a0-81697de5358b

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-w95pb_e3fc4c59-9814-4394-85a0-81697de5358b became leader
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-pnq5t

ProbeError

Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

Unhealthy

Readiness probe failed: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-cf7zm

ProbeError

Readiness probe error: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

Unhealthy

Readiness probe failed: Get "http://10.133.1.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

ProbeError

Readiness probe error: Get "http://10.133.1.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

ProbeError

Readiness probe error: Get "http://10.133.1.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-66v28

Unhealthy

Readiness probe failed: Get "http://10.133.1.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-htjfk

ProbeError

Readiness probe error: Get "http://10.133.1.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-wgbb7

Unhealthy

Readiness probe failed: Get "http://10.133.1.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

Unhealthy

Readiness probe failed: Get "http://10.133.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-jl6c9

ProbeError

Readiness probe error: Get "http://10.133.1.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

Unhealthy

Readiness probe failed: Get "http://10.132.1.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-m4rk6

ProbeError

Readiness probe error: Get "http://10.132.1.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7f5667f86c-7xqxx

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)