Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv to ip-10-0-128-132.ec2.internal

ai-tenants

e2e-api-a-9f7f01

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-9f7f01: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-b2ec05

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-b2ec05: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-6a3af1

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-6a3af1: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-96339b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-96339b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-c79cde

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-c79cde: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-f7f44a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-f7f44a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-ecec44

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-ecec44: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh to ip-10-0-128-132.ec2.internal

ai-tenants

e2e-extmod-a-035dac

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-035dac: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-14fcb6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-14fcb6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-25f7a6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-25f7a6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-740f09

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-740f09: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-ef5efe

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-ef5efe: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-00d004

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-00d004: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-0e422b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-0e422b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-90cda9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-90cda9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-936529

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-936529: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-e3396f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-e3396f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-23f720

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-23f720: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-5f8899

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-5f8899: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-6563ed

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-6563ed: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-bbb7d0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-bbb7d0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-e8a402

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-e8a402: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-357b30

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-357b30: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-361c3a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-361c3a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-48d74e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-48d74e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-8962e9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-8962e9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-9139ec

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-9139ec: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-59060a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-59060a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-729108

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-729108: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-e6ceda

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-e6ceda: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-eb24df

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-eb24df: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-f0cf7e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-f0cf7e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-078fd3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-078fd3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-299e74

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-299e74: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-77cf70

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-77cf70: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-97de36

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-97de36: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-d7801d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-d7801d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-b8a8dc4c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-b8a8dc4c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-cd1386cb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-cd1386cb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-b271f0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-b271f0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-c0d4cb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-c0d4cb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-d6d314

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-d6d314: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-ee509d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-ee509d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-74ba71

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-74ba71: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-9750c7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-9750c7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-d3a281

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-d3a281: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-e93a4b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-e93a4b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-8032f3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-8032f3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-a6f2c0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-a6f2c0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-ed56b9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-ed56b9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-e7561a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-e7561a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-43be82

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-43be82: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-1aa18c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-1aa18c: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-1e14d4

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-1e14d4: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-6416f0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-6416f0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-5514e5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-5514e5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-61e341

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-61e341: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-95ee26

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-95ee26: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-068756

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-068756: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-843978

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-843978: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-htlgr

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-htlgr to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx to ip-10-0-128-132.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-nwggq

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-nwggq to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn to ip-10-0-128-132.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-864lb

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-864lb to ip-10-0-134-229.ec2.internal

opendatahub

ai-gateway-controller-64577f84c6-5nmh8

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-64577f84c6-5nmh8 to ip-10-0-128-132.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-7js7d

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-7js7d to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf to ip-10-0-128-132.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-klw92

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-klw92 to ip-10-0-134-229.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-vd4d6

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-vd4d6 to ip-10-0-134-229.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-n5tzn

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-n5tzn to ip-10-0-134-229.ec2.internal

opendatahub

maas-controller-5597f6b9f6-blz6m

Scheduled

Successfully assigned opendatahub/maas-controller-5597f6b9f6-blz6m to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z to ip-10-0-134-229.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-mgzwt

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-mgzwt to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7 to ip-10-0-135-160.ec2.internal

kuadrant-system

authorino-57f544d9f9-84fxt

Scheduled

Successfully assigned kuadrant-system/authorino-57f544d9f9-84fxt to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f to ip-10-0-128-132.ec2.internal

kuadrant-system

authorino-57f7f8659f-x9j58

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-x9j58 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6 to ip-10-0-135-160.ec2.internal

kuadrant-system

authorino-6768bb47c6-q87t7

Scheduled

Successfully assigned kuadrant-system/authorino-6768bb47c6-q87t7 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-ecec44-745988df69-7p8l8 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42 to ip-10-0-128-132.ec2.internal

kuadrant-system

authorino-6889cbd8c4-7j59j

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-7j59j to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb to ip-10-0-128-132.ec2.internal

kuadrant-system

authorino-6f6944bcdd-4s8hv

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-4s8hv to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-96339b-664bfbb49-hspsz to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k to ip-10-0-128-132.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-b88v5

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-b88v5 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-7dbf4f4996-66pcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-7dbf4f4996-66pcj to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-7b49d5f75d-mlqv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-7b49d5f75d-mlqv7 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-55fbbbf9dc-r6rdp

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-r6rdp to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr to ip-10-0-135-160.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-cxwbd

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-cxwbd to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn to ip-10-0-128-132.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-rdc2r

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-rdc2r to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

Scheduled

Successfully assigned openshift-ingress/e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w to ip-10-0-135-160.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-5nrjn

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-5nrjn to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg to ip-10-0-128-132.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-jpm5x

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jpm5x to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

Scheduled

Successfully assigned openshift-ingress/e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t to ip-10-0-135-160.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-k5ks5 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j to ip-10-0-135-160.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-9hzth

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-9hzth to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh to ip-10-0-135-160.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-l9pbf

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-l9pbf to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg to ip-10-0-128-132.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-v9xwk

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-v9xwk to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl to ip-10-0-135-160.ec2.internal

opendatahub

maas-controller-5597f6b9f6-cbcqg

Scheduled

Successfully assigned opendatahub/maas-controller-5597f6b9f6-cbcqg to ip-10-0-128-132.ec2.internal

ai-tenants

e2e-api-a-97e08c

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-97e08c: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-96339b-openshift-default-857fd4b79-52nqm to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg to ip-10-0-128-132.ec2.internal

ai-tenants

e2e-explicit-e430c7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-e430c7: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487 to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-27twq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-27twq to ip-10-0-134-229.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-noten-7aca74-openshift-default-5df749499f-n9t77

Scheduled

Successfully assigned openshift-ingress/e2e-noten-7aca74-openshift-default-5df749499f-n9t77 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv to ip-10-0-134-229.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-tz6wl to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv to ip-10-0-134-229.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-hrm6f to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585 to ip-10-0-128-132.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-md2qx

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-md2qx to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg to ip-10-0-134-229.ec2.internal

llm

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

Scheduled

Successfully assigned llm/e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx to ip-10-0-128-132.ec2.internal

openshift-ingress

kube-auth-proxy-9c9fcfcf5-hjsfn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9c9fcfcf5-hjsfn to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx to ip-10-0-128-132.ec2.internal

llm

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Scheduled

Successfully assigned llm/e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4 to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-2t5gf to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-2x5c4 to ip-10-0-135-160.ec2.internal

opendatahub

maas-controller-5597f6b9f6-zx498

Scheduled

Successfully assigned opendatahub/maas-controller-5597f6b9f6-zx498 to ip-10-0-128-132.ec2.internal

llm

e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

Scheduled

Successfully assigned llm/e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr to ip-10-0-128-132.ec2.internal

openshift-ingress

kube-auth-proxy-9c9fcfcf5-9pxlh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9c9fcfcf5-9pxlh to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j to ip-10-0-128-132.ec2.internal

models-as-a-service

payload-processing-external-model-9588b4f4b-jbz64

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-9588b4f4b-jbz64 to ip-10-0-134-229.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-ghq5p

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-ghq5p to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-97e08c-openshift-default-f7c78f497-p9554 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-pre-processing-86f4845867-n579j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-86f4845867-n579j to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-qg68n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-qg68n to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-pre-processing-6f7bc57488-96bzn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6f7bc57488-96bzn to ip-10-0-128-132.ec2.internal

ai-tenants

e2e-api-a-785a7a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-785a7a: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp to ip-10-0-128-132.ec2.internal

llm

e2e-same-id-a-f8e64488

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-f8e64488

llm

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

Scheduled

Successfully assigned llm/e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt to ip-10-0-128-132.ec2.internal

opendatahub

maas-controller-689ccbb994-jcbnx

Scheduled

Successfully assigned opendatahub/maas-controller-689ccbb994-jcbnx to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g to ip-10-0-128-132.ec2.internal

models-as-a-service

payload-processing-external-model-84545c695-chvlt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-84545c695-chvlt to ip-10-0-135-160.ec2.internal

openshift-jobset-operator

jobset-controller-manager-6757d7bffd-f8cc7

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-6757d7bffd-f8cc7 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg to ip-10-0-134-229.ec2.internal

models-as-a-service

payload-processing-external-model-7d66d6cd49-xkqsr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7d66d6cd49-xkqsr to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz to ip-10-0-128-132.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wr8nm to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67 to ip-10-0-134-229.ec2.internal

llm

e2e-same-id-b-f8e64488

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-f8e64488

llm

e2e-same-id-b-f8e64488

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-9frnx

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-9frnx to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8 to ip-10-0-128-132.ec2.internal

models-as-a-service

payload-processing-external-model-7d66d6cd49-crnd6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7d66d6cd49-crnd6 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7 to ip-10-0-135-160.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk to ip-10-0-135-160.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vzlw6 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc to ip-10-0-135-160.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-zdk72 to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-xxzqs to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-xj4xk to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-x9hwg to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6 to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-tz7qn to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-sg8t7 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh to ip-10-0-134-229.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-rhhl4 to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-qmrsp to ip-10-0-128-132.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-b82wj

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-b82wj to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-m2dn7 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-k5zn8 to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-jwzmj to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-jr7g7 to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-gbd89

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-gbd89 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx to ip-10-0-135-160.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6455b4886fnlqcc

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6455b4886fnlqcc to ip-10-0-135-160.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-67b54f6f58-qc44f to ip-10-0-135-160.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-67b54f6f58-jvdlq to ip-10-0-134-229.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-67b54f6f58-8hgzl to ip-10-0-128-132.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-cvvr4 to ip-10-0-134-229.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-fx2tt to ip-10-0-134-229.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-f7fjr to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-f5g6c to ip-10-0-135-160.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95 to ip-10-0-135-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-ckslt to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-b2r5w to ip-10-0-135-160.ec2.internal

opendatahub

test-curl-7004-5ffcd5

Scheduled

Successfully assigned opendatahub/test-curl-7004-5ffcd5 to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-9tbj6 to ip-10-0-134-229.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-7kvjr to ip-10-0-128-132.ec2.internal

opendatahub

test-curl-7004-0d46b6

Scheduled

Successfully assigned opendatahub/test-curl-7004-0d46b6 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr to ip-10-0-135-160.ec2.internal

opendatahub

test-curl-7001-b0bffd

Scheduled

Successfully assigned opendatahub/test-curl-7001-b0bffd to ip-10-0-134-229.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-6bnj5 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b to ip-10-0-135-160.ec2.internal

opendatahub

test-curl-7001-6ad656

Scheduled

Successfully assigned opendatahub/test-curl-7001-6ad656 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j to ip-10-0-134-229.ec2.internal

opendatahub

test-curl-7001-5b91d4

Scheduled

Successfully assigned opendatahub/test-curl-7001-5b91d4 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl to ip-10-0-128-132.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5 to ip-10-0-135-160.ec2.internal

opendatahub

test-curl-7001-1a9648

Scheduled

Successfully assigned opendatahub/test-curl-7001-1a9648 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68 to ip-10-0-134-229.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-66rd4 to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-5wtjm to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-4ncwb to ip-10-0-134-229.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-nwfcr

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-nwfcr to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r to ip-10-0-135-160.ec2.internal

opendatahub

test-curl-7001-111df1

Scheduled

Successfully assigned opendatahub/test-curl-7001-111df1 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs to ip-10-0-128-132.ec2.internal

opendatahub

test-curl-6995-76534c

Scheduled

Successfully assigned opendatahub/test-curl-6995-76534c to ip-10-0-134-229.ec2.internal

opendatahub

test-curl-6992-fefa6a

Scheduled

Successfully assigned opendatahub/test-curl-6992-fefa6a to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2 to ip-10-0-128-132.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5bc884dd87-4g2zz to ip-10-0-135-160.ec2.internal

opendatahub

test-curl-6992-a1cce2

Scheduled

Successfully assigned opendatahub/test-curl-6992-a1cce2 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx to ip-10-0-128-132.ec2.internal

models-as-a-service

payload-processing-external-model-579d767848-hbb8t

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-579d767848-hbb8t to ip-10-0-128-132.ec2.internal

opendatahub

odh-model-controller-769875db56-vwd9x

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-vwd9x to ip-10-0-134-229.ec2.internal

opendatahub

test-curl-6992-7f0817

Scheduled

Successfully assigned opendatahub/test-curl-6992-7f0817 to ip-10-0-128-132.ec2.internal

openshift-ingress

router-default-86d86d55f7-vpzjg

Scheduled

Successfully assigned openshift-ingress/router-default-86d86d55f7-vpzjg to ip-10-0-135-160.ec2.internal

openshift-ingress

router-default-86d86d55f7-vpzjg

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-86d86d55f7-vpzjg

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf to ip-10-0-135-160.ec2.internal

models-as-a-service

payload-processing-external-model-57fd545999-tmffg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-57fd545999-tmffg to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7 to ip-10-0-135-160.ec2.internal

models-as-a-service

payload-processing-external-model-5bcd7997-59ffk

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-59ffk to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql to ip-10-0-134-229.ec2.internal

models-as-a-service

payload-processing-external-model-666978d5bb-cjbj2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-666978d5bb-cjbj2 to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq to ip-10-0-128-132.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-l4gld

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-l4gld to ip-10-0-128-132.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lwbxm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwbxm to ip-10-0-128-132.ec2.internal

models-as-a-service

payload-processing-external-model-6b4d54cfdc-cph7t

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b4d54cfdc-cph7t to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72 to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7 to ip-10-0-128-132.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb to ip-10-0-134-229.ec2.internal

models-as-a-service

payload-processing-external-model-7bb658f5fc-rjbpj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7bb658f5fc-rjbpj to ip-10-0-134-229.ec2.internal

models-as-a-service

payload-processing-external-model-6f96cb5db5-7kr55

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6f96cb5db5-7kr55 to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24 to ip-10-0-135-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv to ip-10-0-135-160.ec2.internal

openshift-ingress

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv to ip-10-0-134-229.ec2.internal

openshift-ingress

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7 to ip-10-0-135-160.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-cznj4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cznj4 to ip-10-0-135-160.ec2.internal

models-as-a-service

payload-processing-external-model-7bb658f5fc-8gkrv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7bb658f5fc-8gkrv to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t to ip-10-0-128-132.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795 to ip-10-0-128-132.ec2.internal

models-as-a-service

payload-processing-external-model-7bb658f5fc-c8nzt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7bb658f5fc-c8nzt to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp to ip-10-0-134-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8 to ip-10-0-134-229.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-86d86d55f7 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-86d86d55f7

FailedCreate

Error creating: pods "router-default-86d86d55f7-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-86d86d55f7

SuccessfulCreate

Created pod: router-default-86d86d55f7-vpzjg
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-86d86d55f7-vpzjg

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

Started

Container started

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

Created

Container created

openshift-ingress

kubelet

router-default-86d86d55f7-vpzjg

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-l4gld

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-l4gld

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.445s (2.445s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-2x5c4

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-64695b4bc9

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-64695b4bc9 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.219s (8.219s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-64695b4bc9-kxgth

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.524s (8.524s including waiting). Image size: 183555333 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-ghq5p

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ghq5p

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-ghq5p

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ghq5p

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ghq5p

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-ghq5p

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 1.758s (1.758s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-ghq5p_c75a9998-0583-4ddd-b3e4-115b37068809 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-864lb
(x5)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-864lb

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-864lb

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-864lb

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-864lb

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.22s (3.22s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-864lb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nwggq

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-67b54f6f58

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-67b54f6f58-8hgzl

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-67b54f6f58

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-67b54f6f58-jvdlq

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-67b54f6f58

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-67b54f6f58-qc44f

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-nwggq

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-67b54f6f58 from 0 to 3

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-nwggq

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-67b54f6f58-qc44f

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-k5ks5

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nwggq

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.863s (2.863s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nwggq

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-htlgr

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nwggq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-htlgr

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.889s (2.889s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Started

Container started

cert-manager

multus

cert-manager-597b95cb84-htlgr

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.9s (2.9s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-htlgr

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-htlgr

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.568s (3.568s including waiting). Image size: 273709574 bytes.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-v9xwk

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-v9xwk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 358ms (358ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-67b54f6f58-8hgzl_53e67ad8-7eeb-4a2a-8903-0155eb80f375

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-67b54f6f58-8hgzl_53e67ad8-7eeb-4a2a-8903-0155eb80f375 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 369ms (369ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-8hgzl

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-jvdlq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 370ms (370ms including waiting). Image size: 273709574 bytes.

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-v9xwk

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-67b54f6f58-qc44f

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-v9xwk_92163b97-9dbc-4ce1-b375-afd6e6af30af

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-v9xwk_92163b97-9dbc-4ce1-b375-afd6e6af30af became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-v9xwk

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-v9xwk

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-v9xwk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.929s (1.929s including waiting). Image size: 177967631 bytes.

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-b88v5

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 6.458s (6.458s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-k5ks5_98c7d404-aee7-46f9-af3d-2f77716b96ae

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-k5ks5_98c7d404-aee7-46f9-af3d-2f77716b96ae became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

authorino-operator-7b7bb4bc77-b88v5

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b88v5

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b88v5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.296s (1.296s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b88v5

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b88v5

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-b88v5_4d3d1294-110a-46ea-9fc5-b5af97ce22f5

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-b88v5_4d3d1294-110a-46ea-9fc5-b5af97ce22f5 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-rdc2r

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rdc2r

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-rdc2r

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-cxwbd

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-cxwbd

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-cxwbd

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-cxwbd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.752s (1.752s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-cxwbd

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-cxwbd

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-cxwbd_8e9174fe-2b3d-4144-a23c-c2c7f38f7859

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-cxwbd_8e9174fe-2b3d-4144-a23c-c2c7f38f7859 became leader

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rdc2r

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rdc2r

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-rdc2r

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.704s (4.704s including waiting). Image size: 342538866 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-jpm5x

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-jpm5x

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-jpm5x

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-jpm5x

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-jpm5x

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-9c9fcfcf5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-9c9fcfcf5

SuccessfulCreate

Created pod: kube-auth-proxy-9c9fcfcf5-hjsfn

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-9c9fcfcf5

SuccessfulCreate

Created pod: kube-auth-proxy-9c9fcfcf5-9pxlh

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6455b4886f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6455b4886fnlqcc

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6455b4886f from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6455b4886fnlqcc

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6455b4886fnlqcc

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6455b4886fnlqcc

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6455b4886fnlqcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-9c9fcfcf5-hjsfn

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-9hzth

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-hjsfn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-9pxlh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-9c9fcfcf5-9pxlh

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-74dfcfb894-9hzth

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9hzth

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-x9j58

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-mgzwt

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-l9pbf

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-hjsfn

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-l9pbf

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-hjsfn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.611s (2.611s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

limitador-limitador-7c9b87d574-l9pbf

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

multus

authorino-57f7f8659f-x9j58

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-9pxlh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.497s (2.497s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-56c6c9ddd5-mgzwt

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-9pxlh

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgzwt

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f7f8659f-x9j58

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-9pxlh

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-9c9fcfcf5-hjsfn

Created

Container created

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-k5ks5

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-k5ks5

Killing

Stopping container manager

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9hzth

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.836s (2.836s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9hzth

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9hzth

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-x9j58

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-x9j58

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgzwt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.943s (2.943s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgzwt

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-x9j58

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgzwt

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-l9pbf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.951s (2.951s including waiting). Image size: 133379307 bytes.

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-l9pbf

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-l9pbf

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-x9j58

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.348s (3.348s including waiting). Image size: 204096810 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-bwqhq"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-fhwnl"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-6757d7bffd from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-6757d7bffd

SuccessfulCreate

Created pod: jobset-controller-manager-6757d7bffd-f8cc7

kuadrant-system

kubelet

authorino-57f7f8659f-x9j58

Killing

Stopping container authorino

openshift-jobset-operator

kubelet

jobset-controller-manager-6757d7bffd-f8cc7

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-6757d7bffd-f8cc7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-klw92

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-klw92

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-klw92

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-klw92

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.664s (1.664s including waiting). Image size: 195729000 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-6757d7bffd-f8cc7

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-6757d7bffd-f8cc7

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-6757d7bffd-f8cc7

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.051s (3.051s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-6757d7bffd-f8cc7_18a2cd05-eb10-4d4e-b609-d33f788692d0

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-6757d7bffd-f8cc7_18a2cd05-eb10-4d4e-b609-d33f788692d0 became leader

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-klw92

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-klw92

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-9hzth

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-9hzth

Killing

Stopping container limitador

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-jpm5x_6b7af61e-f634-48bc-aabe-1e00abfebb7a

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-jpm5x_6b7af61e-f634-48bc-aabe-1e00abfebb7a became leader

opendatahub

kserve-module-controller-manager-7566cf5fc8-klw92_b3d5c833-9d87-4121-8af9-394f501b7da5

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-klw92_b3d5c833-9d87-4121-8af9-394f501b7da5 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

maas-controller-689ccbb994

SuccessfulCreate

Created pod: maas-controller-689ccbb994-jcbnx

opendatahub

multus

maas-controller-689ccbb994-jcbnx

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-5597f6b9f6

SuccessfulCreate

Created pod: maas-controller-5597f6b9f6-blz6m

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-689ccbb994 from 0 to 1

opendatahub

kubelet

maas-controller-689ccbb994-jcbnx

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c"

opendatahub

multus

maas-controller-5597f6b9f6-blz6m

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-689ccbb994-jcbnx

Started

Container started

opendatahub

kubelet

maas-controller-689ccbb994-jcbnx

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c" in 2.838s (2.838s including waiting). Image size: 200096245 bytes.

opendatahub

kubelet

maas-controller-689ccbb994-jcbnx

Created

Container created

opendatahub

maas-controller-689ccbb994-jcbnx_d3b8f73a-ebdd-4e80-8b59-d0b676f2137b

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-689ccbb994-jcbnx_d3b8f73a-ebdd-4e80-8b59-d0b676f2137b became leader

opendatahub

kubelet

maas-controller-5597f6b9f6-blz6m

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c" in 2.767s (2.767s including waiting). Image size: 200096245 bytes.

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lwbxm

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lwbxm

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lwbxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-vwd9x

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-nwfcr

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lwbxm

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lwbxm

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-n5tzn

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-7js7d

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-l4gld

Killing

Stopping container discovery

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-n5tzn

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-l4gld

opendatahub

kubelet

odh-model-controller-769875db56-vwd9x

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-vwd9x

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7js7d

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

kserve-controller-manager-776cc66d47-7js7d

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-n5tzn

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-nwfcr

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

model-serving-api-75bd89fdfc-nwfcr

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

replicaset-controller

maas-controller-689ccbb994

SuccessfulDelete

Deleted pod: maas-controller-689ccbb994-jcbnx

opendatahub

kubelet

maas-controller-689ccbb994-jcbnx

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-689ccbb994 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-nwfcr

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-nwfcr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.145s (3.145s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7js7d

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.581s (3.581s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-nwfcr

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-n5tzn

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-n5tzn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.692s (3.692s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-n5tzn

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-7js7d_f409482e-02b0-436d-95b4-bdb904891c60

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-7js7d_f409482e-02b0-436d-95b4-bdb904891c60 became leader

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7js7d

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7js7d

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.966s (13.966s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-vwd9x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.635s (4.635s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-vwd9x

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-cvvr4

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-vwd9x

Started

Container started

opendatahub

odh-model-controller-769875db56-vwd9x_9b991128-805e-4c9d-bf50-68c8f30c539e

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-vwd9x_9b991128-805e-4c9d-bf50-68c8f30c539e became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-n5tzn_60fad555-52f8-45fd-97e8-d97b29a49a3b

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-n5tzn_60fad555-52f8-45fd-97e8-d97b29a49a3b became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-5597f6b9f6-blz6m_5a60d581-3874-4c3d-8a4e-c92af5bd7e95

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5597f6b9f6-blz6m_5a60d581-3874-4c3d-8a4e-c92af5bd7e95 became leader

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

ProbeError

Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-4s8hv

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-7j59j
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-4s8hv

kuadrant-system

replicaset-controller

authorino-57f544d9f9

SuccessfulCreate

Created pod: authorino-57f544d9f9-84fxt

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-7j59j

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f544d9f9 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

kubelet

authorino-57f544d9f9-84fxt

Created

Container created

kuadrant-system

kubelet

authorino-57f544d9f9-84fxt

Started

Container started

kuadrant-system

multus

authorino-57f544d9f9-84fxt

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f544d9f9-84fxt

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-57f544d9f9-84fxt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 549ms (549ms including waiting). Image size: 204096810 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-mgzwt

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-mgzwt
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-vd4d6

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vd4d6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 316ms (317ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vd4d6

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-vd4d6

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vd4d6

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-vd4d6

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-n5tzn

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-n5tzn

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-md2qx

opendatahub

multus

ai-gateway-controller-7d85675f98-md2qx

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-md2qx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-md2qx

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-md2qx

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-md2qx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.296s (2.296s including waiting). Image size: 183979434 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

opendatahub

ai-gateway-controller-7d85675f98-md2qx_58767e44-fbb7-423d-bba8-a2b35ddbed6a

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-md2qx_58767e44-fbb7-423d-bba8-a2b35ddbed6a became leader
(x6)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-processing-55fbbbf9dc-r6rdp

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-qg68n

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qg68n

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-qg68n

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r6rdp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-r6rdp

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qg68n

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r6rdp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qg68n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.403s (2.403s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qg68n

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r6rdp

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r6rdp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.286s (2.286s including waiting). Image size: 125353963 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-64577f84c6 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-64577f84c6

SuccessfulCreate

Created pod: ai-gateway-controller-64577f84c6-5nmh8

opendatahub

kubelet

ai-gateway-controller-64577f84c6-5nmh8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 305ms (305ms including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-64577f84c6-5nmh8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-64577f84c6-5nmh8

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-64577f84c6-5nmh8

Started

Container started

opendatahub

kubelet

ai-gateway-controller-64577f84c6-5nmh8

Created

Container created

opendatahub

llmisvc-controller-manager-6466c554d8-vd4d6_f7363234-6334-4e3e-9460-64c0bf972abf

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-vd4d6_f7363234-6334-4e3e-9460-64c0bf972abf became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-md2qx

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-md2qx

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.383s (1.383s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hsqc5

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 243ms (243ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-tz6wl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.192s (1.192s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

Started

Container started

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-9frnx

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-hrm6f

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9frnx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-9frnx

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9frnx

Created

Container created

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9frnx

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9frnx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 567ms (567ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 270ms (270ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f9vnt

Created

Container created

opendatahub

ai-gateway-controller-64577f84c6-5nmh8_2a11b18a-6a1f-471c-a906-a142d2bad697

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-64577f84c6-5nmh8_2a11b18a-6a1f-471c-a906-a142d2bad697 became leader

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

multus

echo-simulator-kserve-64b6f8f96c-b82wj

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-b82wj

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

echo-simulator-kserve-64b6f8f96c-b82wj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"
(x2)

opendatahub

kubelet

maas-controller-5597f6b9f6-blz6m

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-b82wj

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5597f6b9f6-blz6m

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-b82wj

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-5597f6b9f6-blz6m

Created

Container created

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-b82wj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.532s (1.532s including waiting). Image size: 78208878 bytes.

opendatahub

kubelet

maas-controller-5597f6b9f6-blz6m

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c" in 357ms (357ms including waiting). Image size: 200096245 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 230ms (230ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-kxh95

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Started

Container started

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 227ms (227ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-4g2zz

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-6bnj5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-66rd4

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-66rd4

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.767s (2.767s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Started

Container started

opendatahub

maas-controller-5597f6b9f6-blz6m_b622557a-8670-4c1f-ae61-40650181100b

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5597f6b9f6-blz6m_b622557a-8670-4c1f-ae61-40650181100b became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.7s (2.7s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Started

Container started

kuadrant-system

replicaset-controller

authorino-6768bb47c6

SuccessfulCreate

Created pod: authorino-6768bb47c6-q87t7

kuadrant-system

multus

authorino-6768bb47c6-q87t7

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6768bb47c6-q87t7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6768bb47c6-q87t7

Created

Container created

kuadrant-system

kubelet

authorino-6768bb47c6-q87t7

Started

Container started

kuadrant-system

kubelet

authorino-6768bb47c6-q87t7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 609ms (609ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-57f544d9f9 from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f544d9f9

SuccessfulDelete

Deleted pod: authorino-57f544d9f9-84fxt

kuadrant-system

kubelet

authorino-57f544d9f9-84fxt

Killing

Stopping container authorino
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-tz7qn

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-zdk72

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-m2dn7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-x9hwg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-zdk72

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-f080cb5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f080cb5f

openshift-ingress

deployment-controller

e2e-ait-53b6603d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-53b6603d-openshift-default-5b696f6c9f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-d9dc4ff4-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d9dc4ff4-gw

openshift-ingress

gateway_labeler_controller

e2e-ait-53b6603d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-53b6603d

openshift-ingress

deployment-controller

e2e-ait-f080cb5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f080cb5f-openshift-default-7644d56f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f080cb5f-openshift-default-7644d56f7

SuccessfulCreate

Created pod: e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

openshift-ingress

replicaset-controller

e2e-ait-53b6603d-openshift-default-5b696f6c9f

SuccessfulCreate

Created pod: e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

openshift-ingress

deployment-controller

e2e-migrate-d9dc4ff4-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c

SuccessfulCreate

Created pod: e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

openshift-ingress

multus

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-628cf9bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-628cf9bd

openshift-ingress

deployment-controller

e2e-ait-628cf9bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-628cf9bd-openshift-default-75cb8d8c97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-628cf9bd-openshift-default-75cb8d8c97

SuccessfulCreate

Created pod: e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

openshift-ingress

multus

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d9dc4ff4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d9dc4ff4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d9dc4ff4-84f86c455c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d9dc4ff4: serviceaccount "payload-processing-e2e-migrate-d9dc4ff4" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d9dc4ff4: serviceaccount "payload-processing-e2e-migrate-d9dc4ff4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

openshift-ingress

multus

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

openshift-ingress

deployment-controller

payload-processing-e2e-ait-53b6603d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-53b6603d-6dd9cb5cf7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-53b6603d: serviceaccount "payload-processing-e2e-ait-53b6603d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-53b6603d: serviceaccount "payload-processing-e2e-ait-53b6603d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-53b6603d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f080cb5f-69cb9bc795

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f080cb5f-69cb9bc795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f080cb5f: serviceaccount "payload-processing-e2e-ait-f080cb5f" not found

openshift-ingress

multus

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f080cb5f: serviceaccount "payload-processing-e2e-ait-f080cb5f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f080cb5f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f080cb5f-69cb9bc795 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f080cb5f-69cb9bc795

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

openshift-ingress

kubelet

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f080cb5f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f080cb5f-76f8d88955 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-628cf9bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-628cf9bd: serviceaccount "payload-processing-e2e-ait-628cf9bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

openshift-ingress

kubelet

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.459s (3.459s including waiting). Image size: 125353963 bytes.

openshift-ingress

replicaset-controller

e2e-derive-2f0bef09-openshift-default-6d9ff87485

SuccessfulCreate

Created pod: e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

openshift-ingress

kubelet

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

Started

Container started

openshift-ingress

deployment-controller

e2e-derive-2f0bef09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2f0bef09-openshift-default-6d9ff87485 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-628cf9bd-57b7789fcf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-628cf9bd-57b7789fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-628cf9bd: serviceaccount "payload-processing-e2e-ait-628cf9bd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.932s (1.932s including waiting). Image size: 125353963 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-628cf9bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-628cf9bd-57b7789fcf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.938s (1.938s including waiting). Image size: 125353963 bytes.

openshift-ingress

gateway_labeler_controller

e2e-derive-2f0bef09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2f0bef09

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.442s (3.442s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 689ms (689ms including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-628cf9bd-57b7789fcf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

openshift-ingress

kubelet

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.153s (2.153s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.134s (2.134s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2f0bef09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2f0bef09: serviceaccount "payload-processing-e2e-derive-2f0bef09" not found

openshift-ingress

multus

payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2f0bef09-559657ddff

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2f0bef09-559657ddff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2f0bef09: serviceaccount "payload-processing-e2e-derive-2f0bef09" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2f0bef09-559657ddff

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2f0bef09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2f0bef09-559657ddff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f080cb5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-53b6603d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f080cb5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-53b6603d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Started

Container started

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Created

Container created

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d9dc4ff4-7cd89664f9-t52bl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-d9dc4ff4-84f86c455c-jxx6x

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-53b6603d-6dd9cb5cf7-qg2mg

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f080cb5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f080cb5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-53b6603d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-53b6603d-7b76b95c4c-tx4tb

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-53b6603d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-d9dc4ff4-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-d9dc4ff4-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-d9dc4ff4-gw-openshift-default-9bfdcc79c-w7gqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f080cb5f-76f8d88955-vn85z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f080cb5f-69cb9bc795-9sj7j

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-068756

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-068756

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz
(x2)

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Created

Container created

openshift-ingress

kubelet

e2e-ait-f080cb5f-openshift-default-7644d56f7-t5mlc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-95ee26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-95ee26

openshift-ingress

kubelet

e2e-ait-53b6603d-openshift-default-5b696f6c9f-hsttx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 0 to 1

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-843978

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-843978
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2f0bef09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2f0bef09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-068756

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-068756-bdb7bcbbf from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-068756-bdb7bcbbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-068756

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-068756: serviceaccount "payload-processing-e2e-worker-w3-068756" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-068756-bdb7bcbbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-068756-bdb7bcbbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-068756: serviceaccount "payload-processing-e2e-worker-w3-068756" not found
(x5)

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-628cf9bd-57b7789fcf-djlqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-628cf9bd-54c8dc87f9-khxwv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-95ee26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-95ee26-5f96f56f79

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-95ee26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-95ee26-5f96f56f79 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-95ee26-5f96f56f79

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-95ee26-5f96f56f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-95ee26: serviceaccount "payload-processing-e2e-worker-w2-95ee26" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-95ee26: serviceaccount "payload-processing-e2e-worker-w2-95ee26" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-843978

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-843978-575d4f4c49

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-843978: serviceaccount "payload-processing-e2e-worker-w4-843978" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-843978

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-843978-575d4f4c49 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-843978-575d4f4c49

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-843978-575d4f4c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-843978: serviceaccount "payload-processing-e2e-worker-w4-843978" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-628cf9bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-628cf9bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2f0bef09-6d796cc9ff-ljpnh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2f0bef09-559657ddff-w8cdf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-5514e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-5514e5

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 0 to 1

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-628cf9bd-openshift-default-75cb8d8c97-g77zh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2f0bef09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-2f0bef09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-5514e5-b884d6445

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-5514e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-5514e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-5514e5-b884d6445 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-5514e5-b884d6445

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-5514e5-b884d6445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-5514e5: serviceaccount "payload-processing-e2e-worker-w0-5514e5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-5514e5: serviceaccount "payload-processing-e2e-worker-w0-5514e5" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-61e341

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-61e341

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-2f0bef09-openshift-default-6d9ff87485-mrq7c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-61e341

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-61e341-54bbc99d57 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-61e341-54bbc99d57

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-61e341: serviceaccount "payload-processing-e2e-worker-w1-61e341" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-61e341-54bbc99d57

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-61e341-54bbc99d57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-61e341: serviceaccount "payload-processing-e2e-worker-w1-61e341" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-61e341

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

Started

Container started

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 1 to 2

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-7d66d6cd49

SuccessfulCreate

Created pod: payload-processing-external-model-7d66d6cd49-xkqsr
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-7d66d6cd49

FailedCreate

Error creating: pods "payload-processing-external-model-7d66d6cd49-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-xkqsr

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-xkqsr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-xkqsr

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7d66d6cd49-xkqsr

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-84545c695-chvlt

Started

Container started

models-as-a-service

multus

payload-processing-external-model-84545c695-chvlt

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-84545c695-chvlt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-84545c695-chvlt

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-84545c695

SuccessfulCreate

Created pod: payload-processing-external-model-84545c695-chvlt

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-84545c695 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-fx2tt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-5bc884dd87-k5zn8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7d66d6cd49 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-xkqsr

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7d66d6cd49

SuccessfulDelete

Deleted pod: payload-processing-external-model-7d66d6cd49-xkqsr
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-crnd6

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-crnd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7d66d6cd49 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-7d66d6cd49-crnd6

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-7d66d6cd49

SuccessfulCreate

Created pod: payload-processing-external-model-7d66d6cd49-crnd6

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-crnd6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-84545c695-chvlt

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-84545c695 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-84545c695

SuccessfulDelete

Deleted pod: payload-processing-external-model-84545c695-chvlt

models-as-a-service

kubelet

payload-processing-external-model-7d66d6cd49-crnd6

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 3 to 6

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

Created

Container created

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulCreate

Created pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Created

Container created

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

Started

Container started

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Unhealthy

Liveness probe failed: Get "https://10.132.0.48:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Started

Container started

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 2 to 4
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 4 to 5

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 7 to 10

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Created

Container created

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-cd1386cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cd1386cb
(x10)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-cd1386cb-openshift-default-5979d457c7

SuccessfulCreate

Created pod: e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

openshift-ingress

deployment-controller

e2e-mt-cd1386cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cd1386cb-openshift-default-5979d457c7 from 0 to 1
(x12)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes
(x12)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cd1386cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cd1386cb-7b76784c55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cd1386cb-7b76784c55

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cd1386cb-7b76784c55

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cd1386cb-7b76784c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cd1386cb: serviceaccount "payload-processing-e2e-mt-cd1386cb" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cd1386cb: serviceaccount "payload-processing-e2e-mt-cd1386cb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cd1386cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cd1386cb-556c7759d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 5 to 9

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-a-785a7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-785a7a

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

Started

Container started

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-a-785a7a-openshift-default-57c8cb6f7f

SuccessfulCreate

Created pod: e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-785a7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-785a7a-openshift-default-57c8cb6f7f from 0 to 1

openshift-ingress

multus

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-785a7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-785a7a-7489f6b895 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-785a7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-785a7a-55bc5f549c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-785a7a-7489f6b895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-785a7a-7489f6b895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-785a7a: serviceaccount "payload-processing-e2e-api-a-785a7a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-785a7a-7489f6b895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-785a7a-55bc5f549c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-785a7a-55bc5f549c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-785a7a: serviceaccount "payload-processing-e2e-api-a-785a7a" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-785a7a-55bc5f549c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

Started

Container started

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

Started

Container started

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-785a7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-785a7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 6 to 8

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-vzlw6

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x2)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.024s (3.024s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-785a7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-785a7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-96339b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-96339b-openshift-default-857fd4b79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-96339b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-96339b

openshift-ingress

replicaset-controller

e2e-api-b-96339b-openshift-default-857fd4b79

SuccessfulCreate

Created pod: e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

openshift-ingress

multus

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-96339b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-96339b-664bfbb49 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-96339b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-96339b-696f77c85f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-96339b-664bfbb49

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-96339b-664bfbb49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-96339b: serviceaccount "payload-processing-e2e-api-b-96339b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-96339b-696f77c85f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-96339b-696f77c85f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-96339b: serviceaccount "payload-processing-e2e-api-b-96339b" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-96339b-696f77c85f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

openshift-ingress

multus

payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-96339b-664bfbb49

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

openshift-ingress

kubelet

payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cd1386cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cd1386cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-96339b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-96339b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cd1386cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cd1386cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-a-9f7f01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9f7f01

openshift-ingress

replicaset-controller

e2e-api-a-9f7f01-openshift-default-64d8f9568c

SuccessfulCreate

Created pod: e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

openshift-ingress

deployment-controller

e2e-api-a-9f7f01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9f7f01-openshift-default-64d8f9568c from 0 to 1

openshift-ingress

multus

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 8 to 10

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9f7f01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9f7f01-5548c7f9b5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9f7f01-5548c7f9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9f7f01: serviceaccount "payload-processing-e2e-api-a-9f7f01" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9f7f01: serviceaccount "payload-processing-e2e-api-a-9f7f01" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9f7f01-5548c7f9b5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9f7f01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9f7f01-5548c7f9b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-97e08c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-97e08c-openshift-default-f7c78f497 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-97e08c-openshift-default-f7c78f497

SuccessfulCreate

Created pod: e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

openshift-ingress

gateway_labeler_controller

e2e-api-a-97e08c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-97e08c

openshift-ingress

multus

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-97e08c: serviceaccount "payload-processing-e2e-api-a-97e08c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-97e08c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9f7f01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9f7f01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-97e08c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-97e08c-69f98f57c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-97e08c-69f98f57c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-97e08c-69f98f57c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-97e08c-69f98f57c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-97e08c: serviceaccount "payload-processing-e2e-api-a-97e08c" not found

openshift-ingress

multus

payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-785a7a-7489f6b895-s2swp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-785a7a-55bc5f549c-mkv2x

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.80:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-785a7a-openshift-default-57c8cb6f7f-wp4ql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-96339b-664bfbb49-hspsz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-96339b-696f77c85f-2mlfk

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

ProbeError

Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Unhealthy

Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-mt-cd1386cb-openshift-default-5979d457c7

SuccessfulCreate

Created pod: e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

openshift-ingress

deployment-controller

e2e-mt-cd1386cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cd1386cb-openshift-default-5979d457c7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-cd1386cb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9f7f01-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Started

Container started

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-b-c79cde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c79cde

openshift-ingress

deployment-controller

e2e-api-a-9f7f01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9f7f01-openshift-default-64d8f9568c from 1 to 3

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-a-9f7f01-openshift-default-64d8f9568c

SuccessfulCreate

Created pod: e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

openshift-ingress

replicaset-controller

e2e-api-a-9f7f01-openshift-default-64d8f9568c

SuccessfulCreate

Created pod: e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

Started

Container started

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

Created

Container created

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

Started

Container started

openshift-ingress

multus

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7004-0d46b6

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7004-0d46b6

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-c79cde-openshift-default-54dbf475f7

SuccessfulCreate

Created pod: e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

openshift-ingress

deployment-controller

e2e-api-b-c79cde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c79cde-openshift-default-54dbf475f7 from 0 to 1

openshift-ingress

multus

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

ProbeError

Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Unhealthy

Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

ProbeError

Readiness probe error: Get "http://10.133.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Unhealthy

Readiness probe failed: Get "http://10.133.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7004-0d46b6

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 4.632s (4.632s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7004-0d46b6

Started

Container started

opendatahub

kubelet

test-curl-7004-0d46b6

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c79cde-789d76c79

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c79cde-789d76c79

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c79cde-789d76c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c79cde: serviceaccount "payload-processing-e2e-api-b-c79cde" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c79cde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c79cde-789d76c79 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c79cde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c79cde-76d5b754d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c79cde: serviceaccount "payload-processing-e2e-api-b-c79cde" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Created

Container created

openshift-ingress

multus

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-6a3af1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6a3af1
(x2)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7004-0d46b6

Killing

Stopping container test-curl-7004-0d46b6
(x2)

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-6a3af1-openshift-default-666bcf8bbc

SuccessfulCreate

Created pod: e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

openshift-ingress

deployment-controller

e2e-api-b-6a3af1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6a3af1-openshift-default-666bcf8bbc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-96339b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-96339b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6a3af1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6a3af1-5f4d9f56f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6a3af1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9f7f01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9f7f01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6a3af1-5f4d9f56f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6a3af1-5f4d9f56f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6a3af1: serviceaccount "payload-processing-e2e-api-b-6a3af1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6a3af1-5f4d9f56f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj
(x7)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6a3af1: serviceaccount "payload-processing-e2e-api-b-6a3af1" not found
(x7)

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-96339b-openshift-default-857fd4b79-52nqm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c79cde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c79cde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-cznj4

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-cznj4

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cznj4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-f679b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cznj4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.883s (2.883s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-m98mv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cznj4

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cznj4

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-97e08c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-97e08c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cznj4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a3af1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a3af1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-cznj4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Started

Container started

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Unhealthy

Readiness probe failed: Get "http://10.133.0.92:15021/healthz/ready": read tcp 10.133.0.2:35866->10.133.0.92:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

ProbeError

Readiness probe error: Get "http://10.133.0.92:15021/healthz/ready": read tcp 10.133.0.2:35866->10.133.0.92:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-97e08c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-97e08c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-9f7f01-5548c7f9b5-nq722

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9f7f01-55c4f68b6c-s4sdn

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45

SuccessfulCreate

Created pod: e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

openshift-ingress

deployment-controller

e2e-ipp-a-f0cf7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97e08c-85f68cc5d7-6hzj7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-97e08c-69f98f57c9-gb4vp

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f0cf7e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f0cf7e

openshift-ingress

multus

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cd1386cb-7b76784c55

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cd1386cb-7b76784c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cd1386cb: serviceaccount "payload-processing-e2e-mt-cd1386cb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cd1386cb-7b76784c55

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cd1386cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cd1386cb-556c7759d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cd1386cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cd1386cb-7b76784c55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cd1386cb: serviceaccount "payload-processing-e2e-mt-cd1386cb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-28q8m

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0cf7e: serviceaccount "payload-processing-e2e-ipp-a-f0cf7e" not found

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-pw8tx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f0cf7e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f0cf7e-974cbcff9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f0cf7e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0cf7e: serviceaccount "payload-processing-e2e-ipp-a-f0cf7e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

Started

Container started

openshift-ingress

kubelet

e2e-api-a-9f7f01-openshift-default-64d8f9568c-zd79l

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-c79cde-789d76c79-cnjxb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c79cde-76d5b754d7-2vhqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-97e08c-openshift-default-f7c78f497-p9554

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a3af1-5f4d9f56f-7ggm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a3af1-68cdf5d96c-27tqj

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.114:50052" within 1s: context deadline exceeded
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c79cde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c79cde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-c79cde-openshift-default-54dbf475f7-g56xt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e6ceda

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e6ceda

openshift-ingress

replicaset-controller

e2e-ipp-a-e6ceda-openshift-default-56fffbb7

SuccessfulCreate

Created pod: e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

openshift-ingress

deployment-controller

e2e-ipp-a-e6ceda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e6ceda-openshift-default-56fffbb7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7004-5ffcd5

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e6ceda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e6ceda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e6ceda-779dbb5897 from 0 to 1

opendatahub

kubelet

test-curl-7004-5ffcd5

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7004-5ffcd5

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7004-5ffcd5

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-974cbcff9-gqzcj

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e6ceda-779dbb5897

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e6ceda-779dbb5897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e6ceda: serviceaccount "payload-processing-e2e-ipp-a-e6ceda" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e6ceda-779dbb5897

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-57df56c9cf-9rhzg

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e6ceda: serviceaccount "payload-processing-e2e-ipp-a-e6ceda" not found

openshift-ingress

deployment-controller

e2e-ipp-b-77cf70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-77cf70-openshift-default-d8f7564b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-77cf70-openshift-default-d8f7564b9

SuccessfulCreate

Created pod: e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-77cf70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-77cf70

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7004-5ffcd5

Killing

Stopping container test-curl-7004-5ffcd5

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

Created

Container created

openshift-ingress

multus

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0cf7e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-f0cf7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45 from 1 to 4
(x7)

openshift-ingress

kubelet

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45

SuccessfulCreate

Created pod: e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

openshift-ingress

multus

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45

SuccessfulCreate

Created pod: e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

openshift-ingress

replicaset-controller

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45

SuccessfulCreate

Created pod: e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

Started

Container started

openshift-ingress

multus

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e6ceda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e6ceda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-77cf70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-77cf70-587bc97bcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77cf70-587bc97bcf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

openshift-ingress

kubelet

e2e-api-b-6a3af1-openshift-default-666bcf8bbc-2hjz9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-77cf70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77cf70-587bc97bcf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-77cf70-587bc97bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77cf70: serviceaccount "payload-processing-e2e-ipp-b-77cf70" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77cf70: serviceaccount "payload-processing-e2e-ipp-b-77cf70" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-59060a-openshift-default-8666cdf765

SuccessfulCreate

Created pod: e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-59060a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-59060a

openshift-ingress

deployment-controller

e2e-ipp-a-59060a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-59060a-openshift-default-8666cdf765 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f0cf7e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f0cf7e-7f48c94948 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0cf7e: serviceaccount "payload-processing-e2e-ipp-a-f0cf7e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0cf7e: serviceaccount "payload-processing-e2e-ipp-a-f0cf7e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f0cf7e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.492s (1.492s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.339s (1.339s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-59060a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-59060a: serviceaccount "payload-processing-e2e-ipp-a-59060a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-59060a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-59060a-dc47f5fff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-59060a-dc47f5fff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-59060a-dc47f5fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-59060a: serviceaccount "payload-processing-e2e-ipp-a-59060a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-59060a-dc47f5fff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0cf7e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0cf7e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-dbd545695-ggztc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-779dbb5897-lqnhx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0cf7e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0cf7e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-cd1386cb-7b76784c55-g6lkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cd1386cb-556c7759d7-fwckp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-587bc97bcf-rns5k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-7b6c5d49dc-8rhg4

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e6ceda: serviceaccount "payload-processing-e2e-ipp-a-e6ceda" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e6ceda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e6ceda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e6ceda: serviceaccount "payload-processing-e2e-ipp-a-e6ceda" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

openshift-ingress

multus

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

Started

Container started

openshift-ingress

multus

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-f0cf7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45 from 4 to 6

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45

SuccessfulCreate

Created pod: e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

openshift-ingress

replicaset-controller

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45

SuccessfulCreate

Created pod: e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0cf7e-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

multus

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e6ceda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-e6ceda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-dc47f5fff-g5cgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-75f98c4c8c-kln2x

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Unhealthy

Readiness probe failed: Get "http://10.133.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

ProbeError

Readiness probe error: Get "http://10.133.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77cf70-8686479b7b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-77cf70-8686479b7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77cf70: serviceaccount "payload-processing-e2e-ipp-b-77cf70" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77cf70-8686479b7b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-77cf70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-77cf70-8686479b7b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77cf70: serviceaccount "payload-processing-e2e-ipp-b-77cf70" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-77cf70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77cf70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77cf70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

e2e-ipp-b-97de36-openshift-default-77899d747c

SuccessfulCreate

Created pod: e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

openshift-ingress

deployment-controller

e2e-ipp-b-97de36-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-97de36-openshift-default-77899d747c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-97de36

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-97de36

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-cvshv

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

kubelet

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-b2ec05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b2ec05-openshift-default-5f4c648f59 from 0 to 1

openshift-ingress

kubelet

e2e-mt-cd1386cb-openshift-default-5979d457c7-2msnf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x8)

openshift-ingress

kubelet

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-b2ec05-openshift-default-5f4c648f59

SuccessfulCreate

Created pod: e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

openshift-ingress

gateway_labeler_controller

e2e-api-a-b2ec05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b2ec05

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 6.588s (6.588s including waiting). Image size: 166620835 bytes.
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-59060a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-59060a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 6.875s (6.875s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

Created

Container created

openshift-ingress

multus

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-97de36-5968d699ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-97de36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-97de36: serviceaccount "payload-processing-e2e-ipp-b-97de36" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-97de36-5968d699ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-97de36-5968d699ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-97de36: serviceaccount "payload-processing-e2e-ipp-b-97de36" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-97de36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-97de36-5968d699ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-59060a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-59060a-7954596fdc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-59060a: serviceaccount "payload-processing-e2e-ipp-a-59060a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-59060a-56fc94776

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-59060a-56fc94776-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-59060a: serviceaccount "payload-processing-e2e-ipp-a-59060a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-59060a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-59060a-56fc94776 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-59060a-56fc94776

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b2ec05: serviceaccount "payload-processing-e2e-api-a-b2ec05" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b2ec05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b2ec05-57ff8d5965 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b2ec05-57ff8d5965

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b2ec05-57ff8d5965

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b2ec05-57ff8d5965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b2ec05: serviceaccount "payload-processing-e2e-api-a-b2ec05" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b2ec05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77cf70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77cf70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-729108

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-729108

openshift-ingress

replicaset-controller

e2e-ipp-a-729108-openshift-default-6ff5649589

SuccessfulCreate

Created pod: e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

openshift-ingress

deployment-controller

e2e-ipp-a-729108-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-729108-openshift-default-6ff5649589 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-729108

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-729108

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-729108-5c8649cbff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-729108-5c8649cbff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-729108-5c8649cbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-729108: serviceaccount "payload-processing-e2e-ipp-a-729108" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-59060a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-729108: serviceaccount "payload-processing-e2e-ipp-a-729108" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-59060a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-729108-5c8649cbff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-078fd3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-078fd3

openshift-ingress

multus

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-078fd3-openshift-default-d66545889

SuccessfulCreate

Created pod: e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

openshift-ingress

deployment-controller

e2e-ipp-b-078fd3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-078fd3-openshift-default-d66545889 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-nrntd

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-97de36-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-97de36-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-dvzvq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-078fd3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-078fd3-77854689d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-078fd3: serviceaccount "payload-processing-e2e-ipp-b-078fd3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-078fd3-766c5858bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-078fd3-766c5858bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-078fd3-766c5858bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-078fd3: serviceaccount "payload-processing-e2e-ipp-b-078fd3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-078fd3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-078fd3-766c5858bc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 10 to 6

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-4qdk9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qf7ws

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-vg72r

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-v2xjf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-2hpjf

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-gr5tx

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 10 to 7

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-tlgjz

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-078fd3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-078fd3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-nkmdl

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-64thh

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-4xgzk

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0cf7e-8457687959-2hczd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0cf7e-7f48c94948-2n9fh

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-lm6gm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 7 to 6

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-5968d699ff-z6pxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-q92sm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-npj5h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 8 to 7

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-nsg75

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-rxdxm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql
(x2)

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-hw4gd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kcxql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f0cf7e-openshift-default-86c8ff5b45-jhwxc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-f7f44a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f7f44a

openshift-ingress

deployment-controller

e2e-api-b-f7f44a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f7f44a-openshift-default-765dbcd8cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f7f44a-openshift-default-765dbcd8cf

SuccessfulCreate

Created pod: e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5
(x2)

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-76c57bb9ff-9dv2z

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.116:50052" within 1s: context deadline exceeded

openshift-ingress

multus

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b2ec05-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b2ec05-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f7f44a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f7f44a-584b988b97 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f7f44a: serviceaccount "payload-processing-e2e-api-b-f7f44a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f7f44a-584b988b97

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f7f44a-584b988b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f7f44a: serviceaccount "payload-processing-e2e-api-b-f7f44a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f7f44a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f7f44a-584b988b97

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Unhealthy

Readiness probe failed: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

ProbeError

Readiness probe error: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-5c8649cbff-9xhdl

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-729108-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-6df46f4ff9-qw5p5

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-729108-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-97de36-744bd9758d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-97de36-744bd9758d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-97de36: serviceaccount "payload-processing-e2e-ipp-b-97de36" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-97de36: serviceaccount "payload-processing-e2e-ipp-b-97de36" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-97de36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-97de36-744bd9758d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-97de36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-97de36-744bd9758d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

openshift-ingress

multus

payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-766c5858bc-22nnt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-77854689d7-72s69

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-97de36-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-97de36-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77cf70-8686479b7b-mcd6f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77cf70-86cf7b694c-45888

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b2ec05-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b2ec05-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-729108-6898dcb756

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-729108-6898dcb756-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-729108: serviceaccount "payload-processing-e2e-ipp-a-729108" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-729108

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-729108

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-729108-6898dcb756 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-729108: serviceaccount "payload-processing-e2e-ipp-a-729108" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

openshift-ingress

multus

payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-729108-6898dcb756

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

openshift-ingress

kubelet

e2e-ipp-b-77cf70-openshift-default-d8f7564b9-rftzg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-ee509d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ee509d-openshift-default-5d7f44c765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ee509d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ee509d

openshift-ingress

replicaset-controller

e2e-praxis-a-ee509d-openshift-default-5d7f44c765

SuccessfulCreate

Created pod: e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

openshift-ingress

multus

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-729108-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-729108-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-078fd3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-078fd3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-078fd3-6ff794864d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ee509d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ee509d-6d46494d8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-078fd3: serviceaccount "payload-processing-e2e-ipp-b-078fd3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ee509d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ee509d-5568559575 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-078fd3-6ff794864d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-078fd3-6ff794864d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-078fd3: serviceaccount "payload-processing-e2e-ipp-b-078fd3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ee509d-5568559575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ee509d-5568559575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ee509d: serviceaccount "payload-processing-e2e-praxis-a-ee509d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-078fd3-6ff794864d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ee509d-6d46494d8c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

openshift-ingress

multus

payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ee509d-5568559575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ee509d-6d46494d8c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ee509d-6d46494d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ee509d: serviceaccount "payload-processing-e2e-praxis-a-ee509d" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-b-299e74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-299e74-openshift-default-5dfb594b9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-299e74-openshift-default-5dfb594b9c

SuccessfulCreate

Created pod: e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-299e74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-299e74
(x2)

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Started

Container started

openshift-ingress

multus

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-078fd3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-078fd3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-299e74: serviceaccount "payload-processing-e2e-ipp-b-299e74" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-299e74-865787d6ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-299e74-865787d6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-299e74: serviceaccount "payload-processing-e2e-ipp-b-299e74" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-299e74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-299e74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-299e74-865787d6ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-299e74-865787d6ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-pvg7j

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-z57f9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6ceda-5f55dd9bc9-ck582

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6ceda-6dc8fb7994-zz6q7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b2ec05-5f876cd47f-c5rzq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b2ec05-57ff8d5965-9k4gl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-e6ceda-openshift-default-56fffbb7-8qpgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-59060a-7954596fdc-tlvvv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-59060a-56fc94776-w9pkw

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-7s2lq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 8 to 7

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-59060a-openshift-default-8666cdf765-hfz77

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-b2ec05-openshift-default-5f4c648f59-bldmv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f7f44a-bdf9b95cf-2dqpg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f7f44a-584b988b97-tzb42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Unhealthy

Readiness probe failed: Get "http://10.132.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

ProbeError

Readiness probe error: Get "http://10.132.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f7f44a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f7f44a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-97de36-59d99bc75f-hbhc5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-97de36-744bd9758d-jhcpn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-078fd3-7b66f65b99-7cclg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-078fd3-6ff794864d-8sxnf

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-praxis-a-b271f0-openshift-default-5544549cdf

SuccessfulCreate

Created pod: e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b271f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b271f0

openshift-ingress

deployment-controller

e2e-praxis-a-b271f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b271f0-openshift-default-5544549cdf from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused

openshift-ingress

multus

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-97de36-openshift-default-77899d747c-cq4bc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b271f0-6966d4c887

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b271f0: serviceaccount "payload-processing-e2e-praxis-a-b271f0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b271f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b271f0-6966d4c887 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c

SuccessfulCreate

Created pod: e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b271f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-e93a4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-e93a4b

openshift-ingress

deployment-controller

e2e-praxis-b-e93a4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b271f0-6966d4c887

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b271f0-6966d4c887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b271f0: serviceaccount "payload-processing-e2e-praxis-a-b271f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-078fd3-openshift-default-d66545889-fccnw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-865787d6ff-c8lt4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-7c7d6bb879-bkw2f

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-a-d6d314-openshift-default-5b99b69565

SuccessfulCreate

Created pod: e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

openshift-ingress

multus

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d6d314

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d6d314

openshift-ingress

deployment-controller

e2e-praxis-a-d6d314-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d6d314-openshift-default-5b99b69565 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e93a4b: serviceaccount "payload-processing-e2e-praxis-b-e93a4b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e93a4b-6947c6444f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-e93a4b-6947c6444f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-e93a4b-6947c6444f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-e93a4b: serviceaccount "payload-processing-e2e-praxis-b-e93a4b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-e93a4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-e93a4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-e93a4b-6947c6444f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d6d314

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d6d314-77744649f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d6d314-767dbf49bc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d6d314

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d6d314-767dbf49bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d6d314: serviceaccount "payload-processing-e2e-praxis-a-d6d314" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d6d314-767dbf49bc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d6d314-767dbf49bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d6d314: serviceaccount "payload-processing-e2e-praxis-a-d6d314" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ee509d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ee509d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Unhealthy

Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-eb24df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-eb24df

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

ProbeError

Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-ipp-a-eb24df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-eb24df-openshift-default-67f48b7f65 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-eb24df-openshift-default-67f48b7f65

SuccessfulCreate

Created pod: e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e93a4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e93a4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Created

Container created

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

ProbeError

Readiness probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-f7f44a-openshift-default-765dbcd8cf-t8fz5

Unhealthy

Readiness probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eb24df: serviceaccount "payload-processing-e2e-ipp-a-eb24df" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eb24df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eb24df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eb24df: serviceaccount "payload-processing-e2e-ipp-a-eb24df" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-299e74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-299e74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-299e74-78c848cbc6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-299e74-78c848cbc6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-299e74-78c848cbc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-299e74: serviceaccount "payload-processing-e2e-ipp-b-299e74" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-299e74-78c848cbc6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-299e74: serviceaccount "payload-processing-e2e-ipp-b-299e74" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-299e74-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-299e74-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ee509d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ee509d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d6d314-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d6d314-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b271f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b271f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-9750c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-9750c7

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

openshift-ingress

deployment-controller

e2e-praxis-b-9750c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9750c7-openshift-default-54d64b97d5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9750c7-777968856c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-9750c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-9750c7-777968856c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-9750c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-9750c7-5df98f984c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9750c7-777968856c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-9750c7-777968856c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9750c7: serviceaccount "payload-processing-e2e-praxis-b-9750c7" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9750c7-5df98f984c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-9750c7-5df98f984c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9750c7: serviceaccount "payload-processing-e2e-praxis-b-9750c7" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9750c7-5df98f984c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-299e74-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-299e74-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-d3a281

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-d3a281

openshift-ingress

multus

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-d3a281-openshift-default-6d6f445445

SuccessfulCreate

Created pod: e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

openshift-ingress

deployment-controller

e2e-praxis-b-d3a281-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d3a281-openshift-default-6d6f445445 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Unhealthy

Readiness probe failed: Get "http://10.133.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

ProbeError

Readiness probe error: Get "http://10.133.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

ProbeError

Readiness probe error: Get "http://10.133.0.138:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Unhealthy

Readiness probe failed: Get "http://10.133.0.138:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ee509d-6d46494d8c-q2qwp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ee509d-5568559575-g8848

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d3a281-844b5468d7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-d3a281

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-d3a281-844b5468d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d3a281-844b5468d7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-d3a281-844b5468d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d3a281: serviceaccount "payload-processing-e2e-praxis-b-d3a281" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-d3a281

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-d3a281-58f7476895 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d3a281: serviceaccount "payload-processing-e2e-praxis-b-d3a281" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b271f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b271f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-66rd4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-66rd4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-tz7qn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-tz7qn

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-x9hwg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

ProbeError

Startup probe error: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Unhealthy

Startup probe failed: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-748477f8f5-67vfv

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eb24df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-77b8d4b6bc-b7fx5

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eb24df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-x9hwg

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-ee509d-openshift-default-5d7f44c765-twzdt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e93a4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-e93a4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-7pqzl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-g4lqz

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eb24df: serviceaccount "payload-processing-e2e-ipp-a-eb24df" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eb24df-978647c64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eb24df-978647c64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eb24df: serviceaccount "payload-processing-e2e-ipp-a-eb24df" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eb24df-978647c64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eb24df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eb24df-864494fcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eb24df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eb24df-978647c64 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 7 to 6

openshift-ingress

multus

payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-k8ncb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d6d314-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d6d314-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-e93a4b-bd984bc95-7fwhg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-e93a4b-6947c6444f-8cc8j

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eb24df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eb24df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9750c7-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-9750c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9750c7-openshift-default-54d64b97d5 from 1 to 4

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-e93a4b-openshift-default-7f8c56bf9c-4pjxc

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

Unhealthy

Startup probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

ProbeError

Startup probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-d7801d-openshift-default-674cd67b5

SuccessfulCreate

Created pod: e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

openshift-ingress

deployment-controller

e2e-ipp-b-d7801d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d7801d-openshift-default-674cd67b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d7801d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d7801d
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

Unhealthy

Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

ProbeError

Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-gwgjr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 6 to 5

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b271f0-547b5469dc-42kll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b271f0-6966d4c887-jthwp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d7801d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d7801d: serviceaccount "payload-processing-e2e-ipp-b-d7801d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d7801d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d7801d-c576f4dc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d7801d-c576f4dc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d7801d-c576f4dc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d7801d-c576f4dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d7801d: serviceaccount "payload-processing-e2e-ipp-b-d7801d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9750c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9750c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d6d314-77744649f9-rf95p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d6d314-767dbf49bc-55rvd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-d6d314-openshift-default-5b99b69565-2kkgt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9750c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9750c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-l2rfn

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3a281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3a281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-ng469

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3a281-844b5468d7-hvsnh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3a281-58f7476895-tpwjx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-b-9750c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9750c7-openshift-default-54d64b97d5 from 4 to 8

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-b271f0-openshift-default-5544549cdf-q9c6j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9750c7-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-praxis-b-9750c7-openshift-default-54d64b97d5

SuccessfulCreate

Created pod: e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3a281-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3a281-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

Created

Container created

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9750c7-5df98f984c-mplnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9750c7-777968856c-59jjs

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Unhealthy

Readiness probe failed: Get "http://10.133.0.161:15021/healthz/ready": read tcp 10.133.0.2:58856->10.133.0.161:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

ProbeError

Readiness probe error: Get "http://10.133.0.161:15021/healthz/ready": read tcp 10.133.0.2:58856->10.133.0.161:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-867c88bd6c-2h9kh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-c576f4dc9-2fddw

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Unhealthy

Startup probe failed: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-tl2km

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

ProbeError

Startup probe error: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulCreate

Created pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

Created

Container created

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

Created

Container created

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d7801d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

Unhealthy

Readiness probe failed: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-s6fz4

openshift-ingress

kubelet

e2e-praxis-b-d3a281-openshift-default-6d6f445445-tgc9x

ProbeError

Readiness probe error: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 6 to 4
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d7801d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ckc4l

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-75v6w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d7801d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d7801d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d7801d-678658877b from 0 to 1

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-qk4rv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vp222

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d7801d-678658877b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-pz8j5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vv85t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-wmzzn

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d7801d: serviceaccount "payload-processing-e2e-ipp-b-d7801d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-7s5dv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-s8hnh

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d7801d-678658877b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d7801d-678658877b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d7801d: serviceaccount "payload-processing-e2e-ipp-b-d7801d" not found

openshift-ingress

kubelet

e2e-praxis-b-9750c7-openshift-default-54d64b97d5-vn4qx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d7801d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d7801d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-729108-7f68cf4d79-8clxs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-729108-6898dcb756-ksksg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-729108-openshift-default-6ff5649589-xrnk4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Created

Container created

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eb24df-978647c64-qz72f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eb24df-864494fcf-kzf6t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-299e74-f6d59fd87-5s5pn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-299e74-78c848cbc6-xk4wx

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-299e74-openshift-default-5dfb594b9c-zjdwl

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-eb24df-openshift-default-67f48b7f65-fg527

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

ProbeError

Readiness probe error: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Unhealthy

Readiness probe failed: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7801d-5f9f5c649f-9frfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7801d-678658877b-bwjnd

Killing

Stopping container payload-processing
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

ProbeError

Startup probe error: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

ProbeError

Startup probe error: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

Unhealthy

Startup probe failed: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Unhealthy

Startup probe failed: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

Created

Container created

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f

SuccessfulCreate

Created pod: e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

openshift-ingress

deployment-controller

e2e-praxis-a-c0d4cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c0d4cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c0d4cb

openshift-ingress

multus

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-d7801d-openshift-default-674cd67b5-xgb9d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Unhealthy

Readiness probe failed: Get "http://10.133.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

ProbeError

Readiness probe error: Get "http://10.133.0.173:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c0d4cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c0d4cb: serviceaccount "payload-processing-e2e-praxis-a-c0d4cb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c0d4cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c0d4cb: serviceaccount "payload-processing-e2e-praxis-a-c0d4cb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-ed56b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ed56b9-openshift-default-789859d697 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-a-w1-a6f2c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf

SuccessfulCreate

Created pod: e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-a6f2c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-a6f2c0

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ed56b9-openshift-default-789859d697

SuccessfulCreate

Created pod: e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ed56b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ed56b9

openshift-ingress

multus

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-e7561a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-e7561a

openshift-ingress

deployment-controller

e2e-shared-a-w3-e7561a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e7561a-openshift-default-7598f89b79 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79

SuccessfulCreate

Created pod: e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-a6f2c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-a6f2c0: serviceaccount "payload-processing-e2e-shared-a-w1-a6f2c0" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-a6f2c0: serviceaccount "payload-processing-e2e-shared-a-w1-a6f2c0" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-a6f2c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ed56b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ed56b9: serviceaccount "payload-processing-e2e-shared-a-w2-ed56b9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ed56b9: serviceaccount "payload-processing-e2e-shared-a-w2-ed56b9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ed56b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e7561a: serviceaccount "payload-processing-e2e-shared-a-w3-e7561a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e7561a: serviceaccount "payload-processing-e2e-shared-a-w3-e7561a" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-e7561a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-e7561a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

Started

Container started

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-8032f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-8032f3

openshift-ingress

deployment-controller

e2e-shared-a-w0-8032f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-8032f3-openshift-default-765d774fdc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc

SuccessfulCreate

Created pod: e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

openshift-ingress

multus

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

ProbeError

Startup probe error: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

Unhealthy

Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

ProbeError

Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

Unhealthy

Startup probe failed: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-8032f3-86595cb565

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-8032f3-86595cb565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-8032f3: serviceaccount "payload-processing-e2e-shared-a-w0-8032f3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-8032f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-8032f3-86595cb565 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-8032f3: serviceaccount "payload-processing-e2e-shared-a-w0-8032f3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-8032f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-8032f3-86595cb565

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-74ba71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-74ba71

openshift-ingress

replicaset-controller

e2e-praxis-b-74ba71-openshift-default-d75495477

SuccessfulCreate

Created pod: e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

openshift-ingress

deployment-controller

e2e-praxis-b-74ba71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-74ba71-openshift-default-d75495477 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-1aa18c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-1aa18c

openshift-ingress

deployment-controller

e2e-shared-b-w1-1aa18c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669

SuccessfulCreate

Created pod: e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

openshift-ingress

multus

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-74ba71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-74ba71-576f84f849 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-74ba71-576f84f849

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-74ba71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e7561a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-74ba71-576f84f849

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-74ba71-576f84f849-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-74ba71: serviceaccount "payload-processing-e2e-praxis-b-74ba71" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e7561a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-74ba71: serviceaccount "payload-processing-e2e-praxis-b-74ba71" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

ProbeError

Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Unhealthy

Readiness probe failed: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Unhealthy

Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

ProbeError

Readiness probe error: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

ProbeError

Readiness probe error: Get "http://10.133.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-1e14d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-1e14d4
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Unhealthy

Readiness probe failed: Get "http://10.133.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-b-w2-1e14d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c

SuccessfulCreate

Created pod: e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

openshift-ingress

multus

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-6416f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-6416f0

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649

SuccessfulCreate

Created pod: e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

openshift-ingress

deployment-controller

e2e-shared-b-w3-6416f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6416f0-openshift-default-6b984f4649 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-1aa18c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-1aa18c: serviceaccount "payload-processing-e2e-shared-b-w1-1aa18c" not found

openshift-ingress

multus

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-1aa18c: serviceaccount "payload-processing-e2e-shared-b-w1-1aa18c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-1aa18c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-1e14d4: serviceaccount "payload-processing-e2e-shared-b-w2-1e14d4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-1e14d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-1e14d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-1e14d4: serviceaccount "payload-processing-e2e-shared-b-w2-1e14d4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a6f2c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a6f2c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6416f0: serviceaccount "payload-processing-e2e-shared-b-w3-6416f0" not found
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-6416f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-6416f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed56b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6416f0: serviceaccount "payload-processing-e2e-shared-b-w3-6416f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed56b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Unhealthy

Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

ProbeError

Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-fx2tt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-2x5c4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 7 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-fx2tt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2x5c4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-43be82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-43be82

openshift-ingress

deployment-controller

e2e-shared-b-w0-43be82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5

SuccessfulCreate

Created pod: e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

openshift-ingress

multus

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-43be82: serviceaccount "payload-processing-e2e-shared-b-w0-43be82" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-43be82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-43be82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-43be82-5566f49cff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-43be82-5566f49cff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-43be82-5566f49cff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-43be82-5566f49cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-43be82: serviceaccount "payload-processing-e2e-shared-b-w0-43be82" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

ProbeError

Readiness probe error: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a6f2c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a6f2c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Unhealthy

Readiness probe failed: Get "http://10.132.0.158:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed56b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Unhealthy

Readiness probe failed: Get "http://10.133.0.187:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-ed56b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

ProbeError

Readiness probe error: Get "http://10.133.0.187:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e7561a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e7561a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

ProbeError

Startup probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Unhealthy

Startup probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8032f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8032f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-74ba71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-74ba71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

ProbeError

Readiness probe error: Get "http://10.132.0.160:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Unhealthy

Readiness probe failed: Get "http://10.132.0.160:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

ProbeError

Readiness probe error: Get "http://10.132.0.161:15021/healthz/ready": read tcp 10.132.0.2:60138->10.132.0.161:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Unhealthy

Readiness probe failed: Get "http://10.132.0.161:15021/healthz/ready": read tcp 10.132.0.2:60138->10.132.0.161:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-74ba71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-74ba71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-1e14d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-1e14d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6416f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6416f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8032f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8032f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-1aa18c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-1aa18c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0d4cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0d4cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-1e14d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-1e14d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6416f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-6416f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-1aa18c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-1aa18c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0d4cb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c0d4cb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-43be82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-43be82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-xs5zn
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-43be82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-43be82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-1aa18c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669

SuccessfulCreate

Created pod: e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

openshift-ingress

deployment-controller

e2e-shared-b-w1-1aa18c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c0d4cb-867cbccf7f-pmph4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c0d4cb-98c64fd4c-qs6bn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-c0d4cb-openshift-default-6798dbb74f-rslvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-74ba71-766cbbf4bc-5m29t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-74ba71-576f84f849-68zpj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-74ba71-openshift-default-d75495477-bbs44

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-e430c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-e430c7-openshift-default-8649b6f6fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-e430c7-openshift-default-8649b6f6fc

SuccessfulCreate

Created pod: e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

openshift-ingress

gateway_labeler_controller

e2e-explicit-e430c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-e430c7

openshift-ingress

multus

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-e430c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-e430c7-85548db555 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-e430c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-e430c7-75f68d8dd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-e430c7-85548db555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-e430c7-85548db555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-e430c7: serviceaccount "payload-processing-e2e-explicit-e430c7" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-e430c7-75f68d8dd5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-e430c7-75f68d8dd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-e430c7: serviceaccount "payload-processing-e2e-explicit-e430c7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-e430c7-75f68d8dd5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-e430c7-85548db555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w1-a6f2c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf

SuccessfulCreate

Created pod: e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a6f2c0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e430c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e430c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-52bzl

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-fwt4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-vtpz8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-mdchl

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-fbc46

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-cdnsv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-bbgw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-znwwt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Unhealthy

Readiness probe failed: Get "http://10.133.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

ProbeError

Readiness probe error: Get "http://10.133.0.198:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Unhealthy

Startup probe failed: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

ProbeError

Startup probe error: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused body:

opendatahub

multus

test-curl-6992-7f0817

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-6992-7f0817

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-6992-7f0817

Created

Container created

opendatahub

kubelet

test-curl-6992-7f0817

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-kzbft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-qdrs6

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-xqj7h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-62f6p

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-9v8fc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-2lf6g

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-6992-7f0817

Killing

Stopping container test-curl-6992-7f0817

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-jvkjx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-c9d8r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-4b487

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-vzlw6

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vzlw6

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-pnsp7

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-6xvhr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 5 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-6bnj5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-6bnj5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-zdk72
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e430c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e430c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-zdk72

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 3 to 2

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-d7jbc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-sl6nh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-wjlc7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7qxgl

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7001-b0bffd

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7001-b0bffd

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-ecec44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-ecec44

openshift-ingress

replicaset-controller

e2e-autores-ecec44-openshift-default-6d94dccbcf

SuccessfulCreate

Created pod: e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

openshift-ingress

deployment-controller

e2e-autores-ecec44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-ecec44-openshift-default-6d94dccbcf from 0 to 1

openshift-ingress

multus

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7001-b0bffd

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.097s (3.097s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7001-b0bffd

Started

Container started

opendatahub

kubelet

test-curl-7001-b0bffd

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c

SuccessfulCreate

Created pod: e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-1e14d4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w2-1e14d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ecec44-745988df69

SuccessfulCreate

Created pod: payload-processing-e2e-autores-ecec44-745988df69-7p8l8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ecec44: serviceaccount "payload-processing-e2e-autores-ecec44" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-ecec44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-ecec44-745988df69 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ecec44-745988df69

FailedCreate

Error creating: pods "payload-processing-e2e-autores-ecec44-745988df69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ecec44: serviceaccount "payload-processing-e2e-autores-ecec44" not found

opendatahub

kubelet

test-curl-7001-1a9648

Started

Container started

opendatahub

kubelet

test-curl-7001-1a9648

Created

Container created

opendatahub

kubelet

test-curl-7001-1a9648

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-ecec44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-ecec44-5bc4c88cf from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

opendatahub

multus

test-curl-7001-1a9648

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

Created

Container created

opendatahub

kubelet

test-curl-7001-b0bffd

Killing

Stopping container test-curl-7001-b0bffd

openshift-ingress

multus

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e430c7-85548db555-r7xkb

Killing

Stopping container payload-pre-processing

opendatahub

multus

test-curl-7001-111df1

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-e430c7-75f68d8dd5-68xr4

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-7001-111df1

Created

Container created

opendatahub

kubelet

test-curl-7001-111df1

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7001-111df1

Started

Container started

opendatahub

kubelet

test-curl-7001-1a9648

Killing

Stopping container test-curl-7001-1a9648

opendatahub

kubelet

test-curl-7001-111df1

Killing

Stopping container test-curl-7001-111df1

opendatahub

kubelet

test-curl-7001-6ad656

Created

Container created

opendatahub

kubelet

test-curl-7001-6ad656

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7001-6ad656

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7001-6ad656

Started

Container started

opendatahub

multus

test-curl-7001-5b91d4

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Unhealthy

Startup probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

ProbeError

Startup probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7001-5b91d4

Created

Container created

opendatahub

kubelet

test-curl-7001-6ad656

Killing

Stopping container test-curl-7001-6ad656

opendatahub

kubelet

test-curl-7001-5b91d4

Started

Container started

opendatahub

kubelet

test-curl-7001-5b91d4

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-035dac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-035dac

opendatahub

kubelet

test-curl-7001-5b91d4

Killing

Stopping container test-curl-7001-5b91d4

openshift-ingress

replicaset-controller

e2e-extmod-a-035dac-openshift-default-6d5cb5658f

SuccessfulCreate

Created pod: e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

openshift-ingress

deployment-controller

e2e-extmod-a-035dac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-035dac-openshift-default-6d5cb5658f from 0 to 1

openshift-ingress

multus

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-nqrlr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-035dac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-035dac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-035dac-b889bf555 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-035dac: serviceaccount "payload-processing-e2e-extmod-a-035dac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-035dac-b889bf555

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-035dac-b889bf555

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-035dac-b889bf555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-035dac: serviceaccount "payload-processing-e2e-extmod-a-035dac" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c

SuccessfulCreate

Created pod: e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

openshift-ingress

deployment-controller

e2e-extmod-a-25f7a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-25f7a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-25f7a6

openshift-ingress

multus

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-25f7a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-25f7a6: serviceaccount "payload-processing-e2e-extmod-a-25f7a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-25f7a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-25f7a6: serviceaccount "payload-processing-e2e-extmod-a-25f7a6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

openshift-ingress

multus

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-6995-76534c

Started

Container started

opendatahub

kubelet

test-curl-6995-76534c

Created

Container created

opendatahub

kubelet

test-curl-6995-76534c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-6995-76534c

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-6995-76534c

Killing

Stopping container test-curl-6995-76534c

openshift-ingress

deployment-controller

e2e-extmod-a-740f09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-740f09-openshift-default-786896ffcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-740f09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-740f09

openshift-ingress

replicaset-controller

e2e-extmod-a-740f09-openshift-default-786896ffcc

SuccessfulCreate

Created pod: e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-7aca74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-7aca74

openshift-ingress

multus

e2e-noten-7aca74-openshift-default-5df749499f-n9t77

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-7aca74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-7aca74-openshift-default-5df749499f from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-7aca74-openshift-default-5df749499f

SuccessfulCreate

Created pod: e2e-noten-7aca74-openshift-default-5df749499f-n9t77

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-e430c7-openshift-default-8649b6f6fc-vl6ql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-7aca74-openshift-default-5df749499f-n9t77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-7aca74-openshift-default-5df749499f-n9t77

Started

Container started

openshift-ingress

kubelet

e2e-noten-7aca74-openshift-default-5df749499f-n9t77

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-740f09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-740f09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-740f09-9f78f5f99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-740f09-9f78f5f99

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-740f09-9f78f5f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-740f09: serviceaccount "payload-processing-e2e-extmod-a-740f09" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-740f09: serviceaccount "payload-processing-e2e-extmod-a-740f09" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-740f09-9f78f5f99

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-7aca74-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-7aca74-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-7aca74-openshift-default-5df749499f-n9t77

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-035dac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-035dac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

ProbeError

Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

Unhealthy

Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

Unhealthy

Startup probe failed: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

ProbeError

Startup probe error: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-00d004

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-00d004

openshift-ingress

deployment-controller

e2e-extmod-b-00d004-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-00d004-openshift-default-56d4b77877 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-00d004-openshift-default-56d4b77877

SuccessfulCreate

Created pod: e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

openshift-ingress

multus

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-00d004: serviceaccount "payload-processing-e2e-extmod-b-00d004" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-00d004

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-00d004-5dd8cc5b85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-00d004

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-00d004-768498cbc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-00d004: serviceaccount "payload-processing-e2e-extmod-b-00d004" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ecec44-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ecec44-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-035dac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-035dac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c

SuccessfulCreate

Created pod: e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-25f7a6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-25f7a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

Started

Container started

openshift-ingress

multus

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Unhealthy

Readiness probe failed: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

ProbeError

Readiness probe error: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0e422b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0e422b

openshift-ingress

deployment-controller

e2e-extmod-b-0e422b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0e422b-openshift-default-8577f86657 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-0e422b-openshift-default-8577f86657

SuccessfulCreate

Created pod: e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

openshift-ingress

multus

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

ProbeError

Startup probe error: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

Unhealthy

Startup probe failed: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0e422b: serviceaccount "payload-processing-e2e-extmod-b-0e422b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0e422b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0e422b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0e422b: serviceaccount "payload-processing-e2e-extmod-b-0e422b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ecec44-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ecec44-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-90cda9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-90cda9

openshift-ingress

deployment-controller

e2e-extmod-b-90cda9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-90cda9-openshift-default-57f8b6f957 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-90cda9-openshift-default-57f8b6f957

SuccessfulCreate

Created pod: e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

openshift-ingress

multus

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-extmod-a-ef5efe-openshift-default-679746c7d9

SuccessfulCreate

Created pod: e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ef5efe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ef5efe

openshift-ingress

deployment-controller

e2e-extmod-a-ef5efe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ef5efe-openshift-default-679746c7d9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-90cda9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-90cda9: serviceaccount "payload-processing-e2e-extmod-b-90cda9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-90cda9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-90cda9-865d66bfbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-90cda9-865d66bfbf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-90cda9-865d66bfbf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-90cda9-865d66bfbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-90cda9: serviceaccount "payload-processing-e2e-extmod-b-90cda9" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-740f09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-740f09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-autores-ecec44-745988df69-7p8l8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.172:50052" within 1s: context deadline exceeded
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ef5efe-5c765978c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ef5efe-5c765978c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ef5efe: serviceaccount "payload-processing-e2e-extmod-a-ef5efe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ecec44-5bc4c88cf-fnghb

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.187:50052" within 1s: context deadline exceeded
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ef5efe: serviceaccount "payload-processing-e2e-extmod-a-ef5efe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ef5efe-5c765978c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ef5efe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ef5efe-5c765978c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ef5efe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ecec44-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-autores-ecec44-openshift-default-6d94dccbcf

SuccessfulCreate

Created pod: e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

openshift-ingress

deployment-controller

e2e-autores-ecec44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-ecec44-openshift-default-6d94dccbcf from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

Started

Container started

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-25f7a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-25f7a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-bw9fv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-ecec44-openshift-default-6d94dccbcf-thqw7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-14fcb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-14fcb6

openshift-ingress

replicaset-controller

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9

SuccessfulCreate

Created pod: e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

openshift-ingress

deployment-controller

e2e-extmod-a-14fcb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-14fcb6-openshift-default-568ddb87b9 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-740f09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-740f09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-14fcb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-14fcb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-14fcb6-677f77795f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-14fcb6: serviceaccount "payload-processing-e2e-extmod-a-14fcb6" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-14fcb6-677f77795f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-14fcb6-677f77795f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-14fcb6: serviceaccount "payload-processing-e2e-extmod-a-14fcb6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-14fcb6-677f77795f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e422b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e422b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-00d004-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-00d004-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e422b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0e422b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Unhealthy

Readiness probe failed: Get "http://10.132.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

ProbeError

Readiness probe error: Get "http://10.132.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

ProbeError

Readiness probe error: Get "http://10.133.0.217:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Unhealthy

Readiness probe failed: Get "http://10.133.0.217:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Started

Container started

openshift-ingress

multus

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-936529-openshift-default-5578bccc97

SuccessfulCreate

Created pod: e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

openshift-ingress

deployment-controller

e2e-extmod-b-936529-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-936529-openshift-default-5578bccc97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-936529

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-936529
(x2)

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-v9zqm
(x4)

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 4 to 3

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-936529

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-936529-f869b5f7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-936529-5c8d858c85

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-936529-5c8d858c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-936529: serviceaccount "payload-processing-e2e-extmod-b-936529" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-936529: serviceaccount "payload-processing-e2e-extmod-b-936529" not found

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-q7d92

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-936529

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-936529-5c8d858c85 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-936529-5c8d858c85

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Unhealthy

Startup probe failed: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

ProbeError

Startup probe error: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Unhealthy

Startup probe failed: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

ProbeError

Startup probe error: Get "http://10.133.0.216:15021/healthz/ready": dial tcp 10.133.0.216:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef5efe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef5efe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14fcb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14fcb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-vlm67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-7p92j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5

SuccessfulCreate

Created pod: e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-e3396f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-e3396f

openshift-ingress

deployment-controller

e2e-extmod-b-e3396f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-e3396f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e3396f: serviceaccount "payload-processing-e2e-extmod-b-e3396f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-e3396f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e3396f: serviceaccount "payload-processing-e2e-extmod-b-e3396f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef5efe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef5efe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14fcb6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-14fcb6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e3396f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e3396f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Unhealthy

Readiness probe failed: Get "http://10.133.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

ProbeError

Readiness probe error: Get "http://10.133.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Unhealthy

Readiness probe failed: Get "http://10.134.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

ProbeError

Readiness probe error: Get "http://10.134.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

ProbeError

Startup probe error: Get "http://10.133.0.220:15021/healthz/ready": dial tcp 10.133.0.220:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Unhealthy

Startup probe failed: Get "http://10.133.0.220:15021/healthz/ready": dial tcp 10.133.0.220:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

ProbeError

Startup probe error: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Unhealthy

Startup probe failed: Get "http://10.134.0.215:15021/healthz/ready": dial tcp 10.134.0.215:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e3396f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e3396f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-936529-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-936529-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6f96cb5db5 from 0 to 1
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-6f96cb5db5

FailedCreate

Error creating: pods "payload-processing-external-model-6f96cb5db5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

multus

payload-processing-external-model-6f96cb5db5-7kr55

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6f96cb5db5

SuccessfulCreate

Created pod: payload-processing-external-model-6f96cb5db5-7kr55

models-as-a-service

kubelet

payload-processing-external-model-6f96cb5db5-7kr55

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6f96cb5db5-7kr55

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6f96cb5db5-7kr55

Started

Container started
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk
(x7)

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 3 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-kjvzk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 3 to 2
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-qqhmg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-zfdc2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-9588b4f4b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-9588b4f4b-jbz64

Started

Container started

models-as-a-service

multus

payload-processing-external-model-9588b4f4b-jbz64

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-9588b4f4b-jbz64

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-9588b4f4b

SuccessfulCreate

Created pod: payload-processing-external-model-9588b4f4b-jbz64

models-as-a-service

kubelet

payload-processing-external-model-9588b4f4b-jbz64

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-9588b4f4b-jbz64

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-9588b4f4b

SuccessfulDelete

Deleted pod: payload-processing-external-model-9588b4f4b-jbz64

models-as-a-service

replicaset-controller

payload-processing-external-model-7bb658f5fc

SuccessfulCreate

Created pod: payload-processing-external-model-7bb658f5fc-rjbpj

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-9588b4f4b from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-rjbpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-rjbpj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-rjbpj

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7bb658f5fc-rjbpj

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6b4d54cfdc

SuccessfulCreate

Created pod: payload-processing-external-model-6b4d54cfdc-cph7t

models-as-a-service

replicaset-controller

payload-processing-external-model-7bb658f5fc

SuccessfulDelete

Deleted pod: payload-processing-external-model-7bb658f5fc-rjbpj

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b4d54cfdc from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-rjbpj

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6b4d54cfdc-cph7t

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6b4d54cfdc-cph7t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6b4d54cfdc-cph7t

Started

Container started

models-as-a-service

multus

payload-processing-external-model-6b4d54cfdc-cph7t

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-27twq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 3 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-27twq

AddedInterface

Add eth0 [10.134.1.8/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-jwzmj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-xj4xk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-6f96cb5db5

SuccessfulDelete

Deleted pod: payload-processing-external-model-6f96cb5db5-7kr55

models-as-a-service

kubelet

payload-processing-external-model-6f96cb5db5-7kr55

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6f96cb5db5 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7bb658f5fc

SuccessfulCreate

Created pod: payload-processing-external-model-7bb658f5fc-c8nzt

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-c8nzt

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-c8nzt

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-c8nzt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7bb658f5fc-c8nzt

AddedInterface

Add eth0 [10.134.1.9/23] from ovn-kubernetes
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7bb658f5fc from 1 to 0

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-666978d5bb from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7bb658f5fc

SuccessfulDelete

Deleted pod: payload-processing-external-model-7bb658f5fc-c8nzt

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-c8nzt

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-666978d5bb

SuccessfulCreate

Created pod: payload-processing-external-model-666978d5bb-cjbj2

models-as-a-service

kubelet

payload-processing-external-model-666978d5bb-cjbj2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-666978d5bb-cjbj2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-666978d5bb-cjbj2

Created

Container created

models-as-a-service

multus

payload-processing-external-model-666978d5bb-cjbj2

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

Unhealthy

Startup probe failed: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

ProbeError

Startup probe error: Get "http://10.134.1.8:15021/healthz/ready": dial tcp 10.134.1.8:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6f96cb5db5-7kr55

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.247:50052" within 1s: context deadline exceeded
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7bb658f5fc from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-666978d5bb

SuccessfulDelete

Deleted pod: payload-processing-external-model-666978d5bb-cjbj2

models-as-a-service

replicaset-controller

payload-processing-external-model-7bb658f5fc

SuccessfulCreate

Created pod: payload-processing-external-model-7bb658f5fc-8gkrv

models-as-a-service

kubelet

payload-processing-external-model-666978d5bb-cjbj2

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-666978d5bb from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-8gkrv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-8gkrv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-8gkrv

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7bb658f5fc-8gkrv

AddedInterface

Add eth0 [10.134.1.11/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-ckslt

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-sg8t7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

AddedInterface

Add eth0 [10.134.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-b2r5w

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-ckslt

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-xxzqs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Created

Container created
(x6)

models-as-a-service

kubelet

payload-processing-external-model-6b4d54cfdc-cph7t

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-433df49ba6f6" not found
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Unhealthy

Startup probe failed: Get "http://10.134.1.15:15021/healthz/ready": dial tcp 10.134.1.15:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

ProbeError

Startup probe error: Get "http://10.134.1.15:15021/healthz/ready": dial tcp 10.134.1.15:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6b4d54cfdc-cph7t

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Unhealthy

Startup probe failed: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

ProbeError

Startup probe error: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-6b4d54cfdc

SuccessfulDelete

Deleted pod: payload-processing-external-model-6b4d54cfdc-cph7t
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79

SuccessfulCreate

Created pod: e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e7561a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w3-e7561a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e7561a-openshift-default-7598f89b79 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

Started

Container started

openshift-ingress

multus

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-25f7a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-25f7a6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c

SuccessfulCreate

Created pod: e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

AddedInterface

Add eth0 [10.134.1.23/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-90cda9-openshift-default-57f8b6f957

SuccessfulCreate

Created pod: e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

openshift-ingress

deployment-controller

e2e-extmod-b-90cda9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-90cda9-openshift-default-57f8b6f957 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

Started

Container started

openshift-ingress

multus

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

Unhealthy

Startup probe failed: Get "http://10.134.1.23:15021/healthz/ready": dial tcp 10.134.1.23:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

ProbeError

Startup probe error: Get "http://10.134.1.23:15021/healthz/ready": dial tcp 10.134.1.23:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-ef5efe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ef5efe-openshift-default-679746c7d9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef5efe-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-ef5efe-openshift-default-679746c7d9

SuccessfulCreate

Created pod: e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Created

Container created

openshift-ingress

multus

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

AddedInterface

Add eth0 [10.134.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-wr8nm

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Started

Container started
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

AddedInterface

Add eth0 [10.134.1.25/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Unhealthy

Startup probe failed: Get "http://10.133.0.224:15021/healthz/ready": dial tcp 10.133.0.224:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

ProbeError

Startup probe error: Get "http://10.133.0.224:15021/healthz/ready": dial tcp 10.133.0.224:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

Unhealthy

Startup probe failed: Get "http://10.134.1.25:15021/healthz/ready": dial tcp 10.134.1.25:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

ProbeError

Startup probe error: Get "http://10.134.1.25:15021/healthz/ready": dial tcp 10.134.1.25:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-57fd545999

SuccessfulCreate

Created pod: payload-processing-external-model-57fd545999-tmffg

models-as-a-service

multus

payload-processing-external-model-57fd545999-tmffg

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-57fd545999-tmffg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-57fd545999-tmffg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-57fd545999-tmffg

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-7bb658f5fc

SuccessfulDelete

Deleted pod: payload-processing-external-model-7bb658f5fc-8gkrv

models-as-a-service

kubelet

payload-processing-external-model-7bb658f5fc-8gkrv

Killing

Stopping container payload-processing
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled up replica set payload-processing-external-model-579d767848 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-579d767848-hbb8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-579d767848-hbb8t

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-579d767848

SuccessfulCreate

Created pod: payload-processing-external-model-579d767848-hbb8t

models-as-a-service

kubelet

payload-processing-external-model-579d767848-hbb8t

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-579d767848-hbb8t

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-bbb7d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-bbb7d0

openshift-ingress

multus

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-bbb7d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf

SuccessfulCreate

Created pod: e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-bbb7d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bbb7d0: serviceaccount "payload-processing-e2e-inf-a-bbb7d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-bbb7d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bbb7d0: serviceaccount "payload-processing-e2e-inf-a-bbb7d0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Unhealthy

Readiness probe failed: Get "http://10.134.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

ProbeError

Readiness probe error: Get "http://10.134.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

ProbeError

Readiness probe error: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Unhealthy

Readiness probe failed: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-j9lq5

Unhealthy

Readiness probe failed: Get "https://10.132.0.48:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

ProbeError

Readiness probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Unhealthy

Readiness probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-9139ec-openshift-default-58b88c89b5

SuccessfulCreate

Created pod: e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9139ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9139ec

openshift-ingress

deployment-controller

e2e-inf-b-9139ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9139ec-openshift-default-58b88c89b5 from 0 to 1

openshift-ingress

multus

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x8)

models-as-a-service

kubelet

payload-processing-external-model-57fd545999-tmffg

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-8e7fc4b63cd8" not found

models-as-a-service

kubelet

payload-processing-external-model-57fd545999-tmffg

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-579d767848-hbb8t

Killing

Stopping container payload-processing
(x11)

models-as-a-service

kubelet

payload-processing-external-model-579d767848-hbb8t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9139ec-d598b575f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9139ec-d598b575f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9139ec: serviceaccount "payload-processing-e2e-inf-b-9139ec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9139ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9139ec-d598b575f from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-6563ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6563ed-openshift-default-bbf46f5bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6563ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6563ed

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9139ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9139ec-75499f56ff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9139ec-75499f56ff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9139ec-75499f56ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9139ec: serviceaccount "payload-processing-e2e-inf-b-9139ec" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

AddedInterface

Add eth0 [10.134.1.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

AddedInterface

Add eth0 [10.134.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9139ec-75499f56ff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9139ec-d598b575f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bbb7d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bbb7d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6563ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6563ed-544d484d6c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6563ed-56f84d78c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6563ed-56f84d78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6563ed: serviceaccount "payload-processing-e2e-inf-a-6563ed" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6563ed: serviceaccount "payload-processing-e2e-inf-a-6563ed" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6563ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6563ed-56f84d78c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6563ed-56f84d78c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bbb7d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-bbb7d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-a-5f8899-openshift-default-67cc5d8789

SuccessfulCreate

Created pod: e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

openshift-ingress

deployment-controller

e2e-inf-a-5f8899-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5f8899-openshift-default-67cc5d8789 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-5f8899

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-5f8899

openshift-ingress

multus

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-5f8899

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-5f8899-59548dd96c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5f8899-95f48b575

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-5f8899-95f48b575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5f8899: serviceaccount "payload-processing-e2e-inf-a-5f8899" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5f8899: serviceaccount "payload-processing-e2e-inf-a-5f8899" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-5f8899

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-5f8899-95f48b575 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

AddedInterface

Add eth0 [10.134.1.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5f8899-95f48b575

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-90cda9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-90cda9-openshift-default-57f8b6f957 from 2 to 3

openshift-ingress

replicaset-controller

e2e-extmod-b-90cda9-openshift-default-57f8b6f957

SuccessfulCreate

Created pod: e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

Started

Container started

openshift-ingress

multus

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

AddedInterface

Add eth0 [10.134.1.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

Unhealthy

Startup probe failed: Get "http://10.134.1.39:15021/healthz/ready": dial tcp 10.134.1.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

ProbeError

Startup probe error: Get "http://10.134.1.39:15021/healthz/ready": dial tcp 10.134.1.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Unhealthy

Readiness probe failed: Get "http://10.132.0.193:15021/healthz/ready": read tcp 10.132.0.2:39770->10.132.0.193:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

ProbeError

Readiness probe error: Get "http://10.132.0.193:15021/healthz/ready": read tcp 10.132.0.2:39770->10.132.0.193:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-b-361c3a-openshift-default-6f67d958cf

SuccessfulCreate

Created pod: e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

openshift-ingress

deployment-controller

e2e-inf-b-361c3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-361c3a-openshift-default-6f67d958cf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-361c3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-361c3a

openshift-ingress

multus

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-361c3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-361c3a-5f8f84cb7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-5f8899-openshift-default-67cc5d8789

SuccessfulCreate

Created pod: e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-361c3a: serviceaccount "payload-processing-e2e-inf-b-361c3a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-361c3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-361c3a-8648dbb499 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-5f8899-openshift-default-67cc5d8789

SuccessfulCreate

Created pod: e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

openshift-ingress

replicaset-controller

e2e-inf-a-5f8899-openshift-default-67cc5d8789

SuccessfulCreate

Created pod: e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f8899-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

AddedInterface

Add eth0 [10.134.1.41/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-361c3a: serviceaccount "payload-processing-e2e-inf-b-361c3a" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-a-5f8899-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5f8899-openshift-default-67cc5d8789 from 1 to 4

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

AddedInterface

Add eth0 [10.134.1.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Started

Container started

openshift-ingress

multus

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Unhealthy

Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

ProbeError

Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Unhealthy

Startup probe failed: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Unhealthy

Startup probe failed: Get "http://10.134.1.41:15021/healthz/ready": dial tcp 10.134.1.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

ProbeError

Startup probe error: Get "http://10.134.1.41:15021/healthz/ready": dial tcp 10.134.1.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

ProbeError

Startup probe error: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Unhealthy

Startup probe failed: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

ProbeError

Startup probe error: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-361c3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-361c3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-b-48d74e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-48d74e

openshift-ingress

replicaset-controller

e2e-inf-b-48d74e-openshift-default-5b465bf649

SuccessfulCreate

Created pod: e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

openshift-ingress

deployment-controller

e2e-inf-b-48d74e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-48d74e-openshift-default-5b465bf649 from 0 to 1

openshift-ingress

multus

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f8899-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f8899-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-48d74e-77f759984c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-48d74e-77f759984c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-48d74e: serviceaccount "payload-processing-e2e-inf-b-48d74e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-48d74e-57f8487987

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-48d74e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-48d74e-57f8487987 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-48d74e-57f8487987

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-48d74e-57f8487987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-48d74e: serviceaccount "payload-processing-e2e-inf-b-48d74e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-48d74e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-48d74e-77f759984c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-48d74e-77f759984c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f8899-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f8899-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9139ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9139ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-a-5f8899-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5f8899-openshift-default-67cc5d8789 from 4 to 5

openshift-ingress

replicaset-controller

e2e-inf-a-5f8899-openshift-default-67cc5d8789

SuccessfulCreate

Created pod: e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

openshift-ingress

multus

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-5f8899-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-361c3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-361c3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-48d74e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-48d74e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-e8a402

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-e8a402

openshift-ingress

multus

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-e8a402-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-e8a402-openshift-default-869f646c59 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-e8a402-openshift-default-869f646c59

SuccessfulCreate

Created pod: e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-e8a402

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-e8a402-bd7d6fcbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-e8a402

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e8a402: serviceaccount "payload-processing-e2e-inf-a-e8a402" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-e8a402: serviceaccount "payload-processing-e2e-inf-a-e8a402" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

AddedInterface

Add eth0 [10.134.1.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

AddedInterface

Add eth0 [10.134.1.67/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-48d74e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-48d74e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9
(x2)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-a-6563ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6563ed-openshift-default-bbf46f5bf from 1 to 4

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

AddedInterface

Add eth0 [10.134.1.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5

SuccessfulCreate

Created pod: e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

openshift-ingress

deployment-controller

e2e-inf-a-23f720-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-23f720-openshift-default-6c8d4f9ff5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-23f720

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-23f720

openshift-ingress

multus

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

ProbeError

Startup probe error: Get "http://10.134.1.72:15021/healthz/ready": dial tcp 10.134.1.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

Unhealthy

Startup probe failed: Get "http://10.134.1.72:15021/healthz/ready": dial tcp 10.134.1.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

Unhealthy

Startup probe failed: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

ProbeError

Startup probe error: Get "http://10.132.0.213:15021/healthz/ready": dial tcp 10.132.0.213:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-23f720-7cd49f58f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

AddedInterface

Add eth0 [10.134.1.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-23f720

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-23f720-7cd49f58f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-23f720-7cd49f58f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-23f720: serviceaccount "payload-processing-e2e-inf-a-23f720" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-23f720

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-23f720-7cd49f58f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-23f720: serviceaccount "payload-processing-e2e-inf-a-23f720" not found

openshift-ingress

replicaset-controller

e2e-inf-b-361c3a-openshift-default-6f67d958cf

SuccessfulCreate

Created pod: e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

openshift-ingress

kubelet

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-361c3a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-361c3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-361c3a-openshift-default-6f67d958cf from 1 to 2

openshift-ingress

multus

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

AddedInterface

Add eth0 [10.134.1.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Started

Container started

openshift-ingress

multus

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Unhealthy

Startup probe failed: Get "http://10.133.0.246:15021/healthz/ready": dial tcp 10.133.0.246:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

ProbeError

Startup probe error: Get "http://10.133.0.246:15021/healthz/ready": dial tcp 10.133.0.246:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-inf-a-6563ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6563ed-openshift-default-bbf46f5bf from 4 to 8

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

Created

Container created

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

AddedInterface

Add eth0 [10.133.0.247/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

AddedInterface

Add eth0 [10.133.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

AddedInterface

Add eth0 [10.134.1.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

Started

Container started

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

Unhealthy

Startup probe failed: Get "http://10.134.1.75:15021/healthz/ready": dial tcp 10.134.1.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

ProbeError

Startup probe error: Get "http://10.134.1.75:15021/healthz/ready": dial tcp 10.134.1.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

Unhealthy

Startup probe failed: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

ProbeError

Startup probe error: Get "http://10.133.0.248:15021/healthz/ready": dial tcp 10.133.0.248:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

Unhealthy

Startup probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

ProbeError

Startup probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-785rf

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e7561a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-e7561a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-e7561a-openshift-default-7598f89b79 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6563ed-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-inf-a-6563ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6563ed-openshift-default-bbf46f5bf from 8 to 9

openshift-ingress

replicaset-controller

e2e-inf-a-6563ed-openshift-default-bbf46f5bf

SuccessfulCreate

Created pod: e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-25f7a6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-25f7a6-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

multus

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

AddedInterface

Add eth0 [10.134.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-jlpqh

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-90cda9-openshift-default-57f8b6f957

SuccessfulDelete

Deleted pod: e2e-extmod-b-90cda9-openshift-default-57f8b6f957-7gqw6

openshift-ingress

deployment-controller

e2e-extmod-b-90cda9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-90cda9-openshift-default-57f8b6f957 from 3 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-1e14d4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w2-1e14d4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-bc6xr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

Unhealthy

Startup probe failed: Get "http://10.134.1.76:15021/healthz/ready": dial tcp 10.134.1.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-67sz9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

ProbeError

Startup probe error: Get "http://10.134.1.76:15021/healthz/ready": dial tcp 10.134.1.76:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wr8nm

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-wr8nm

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

Unhealthy

Readiness probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-jdj7d

ProbeError

Readiness probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-jwzmj

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xxzqs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jwzmj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-b2r5w

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-xxzqs

openshift-ingress

replicaset-controller

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-x45sj
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-b2r5w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 10 to 7

openshift-ingress

deployment-controller

e2e-shared-a-w1-a6f2c0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a6f2c0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

multus

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

AddedInterface

Add eth0 [10.134.1.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-9139ec-openshift-default-58b88c89b5

SuccessfulCreate

Created pod: e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9139ec-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-9139ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9139ec-openshift-default-58b88c89b5 from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-1aa18c-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w1-1aa18c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-357b30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-357b30

openshift-ingress

deployment-controller

e2e-inf-b-357b30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-357b30-openshift-default-85bd97c49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-357b30-openshift-default-85bd97c49

SuccessfulCreate

Created pod: e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j
(x5)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

Unhealthy

Startup probe failed: Get "http://10.134.1.77:15021/healthz/ready": dial tcp 10.134.1.77:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

ProbeError

Startup probe error: Get "http://10.134.1.77:15021/healthz/ready": dial tcp 10.134.1.77:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-bkjrr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-357b30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-357b30-6fbd545b95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-357b30: serviceaccount "payload-processing-e2e-inf-b-357b30" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-357b30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-357b30-6fbd545b95

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-357b30-6fbd545b95

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-357b30-6fbd545b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-357b30: serviceaccount "payload-processing-e2e-inf-b-357b30" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

AddedInterface

Add eth0 [10.134.1.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

AddedInterface

Add eth0 [10.134.1.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-sg8t7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 7 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-sg8t7
(x6)

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e8a402-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e8a402-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Unhealthy

Readiness probe failed: Get "http://10.133.0.245:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

ProbeError

Readiness probe error: Get "http://10.133.0.245:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8962e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8962e9

openshift-ingress

replicaset-controller

e2e-inf-b-8962e9-openshift-default-875c5bccf

SuccessfulCreate

Created pod: e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

openshift-ingress

deployment-controller

e2e-inf-b-8962e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8962e9-openshift-default-875c5bccf from 0 to 1

openshift-ingress

multus

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

AddedInterface

Add eth0 [10.134.1.82/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-23f720-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-23f720-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e8a402-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-e8a402-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

ProbeError

Startup probe error: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Unhealthy

Startup probe failed: Get "http://10.133.0.245:15021/healthz/ready": dial tcp 10.133.0.245:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8962e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8962e9-59cc45b88f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8962e9-59cc45b88f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8962e9-59cc45b88f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8962e9: serviceaccount "payload-processing-e2e-inf-b-8962e9" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8962e9: serviceaccount "payload-processing-e2e-inf-b-8962e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8962e9-59cc45b88f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8962e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8962e9-5bf5967579 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

AddedInterface

Add eth0 [10.134.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

AddedInterface

Add eth0 [10.134.1.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-8962e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-8962e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bbb7d0-6bcb48d58c-h8gsp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bbb7d0-7cddbf6b47-z2q7w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-23f720-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-23f720-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-bbb7d0-openshift-default-5dcffb6bdf-h7lps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9139ec-d598b575f-8w9zz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Unhealthy

Readiness probe failed: Get "http://10.132.0.216:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

ProbeError

Readiness probe error: Get "http://10.132.0.216:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9139ec-75499f56ff-2zqj6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

Unhealthy

Startup probe failed: Get "http://10.134.1.82:15021/healthz/ready": dial tcp 10.134.1.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

ProbeError

Startup probe error: Get "http://10.134.1.82:15021/healthz/ready": dial tcp 10.134.1.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Unhealthy

Startup probe failed: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

ProbeError

Startup probe error: Get "http://10.132.0.216:15021/healthz/ready": dial tcp 10.132.0.216:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-357b30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-357b30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-357b30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-357b30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-xf7ls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9139ec-openshift-default-58b88c89b5-525zl

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-8962e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-8962e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6563ed-544d484d6c-mqhj2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6563ed-56f84d78c-7nbmf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-bmcxg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-xprnm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-dkt6x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-p76h9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-5f8899-openshift-default-67cc5d8789-q77g2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5f8899-95f48b575-rlt68

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5f8899-59548dd96c-5p585

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-zqjnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-dbpl9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-j7rnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-b4vsj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-vtq2l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-m29cl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-srqbx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-2ssw6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6563ed-openshift-default-bbf46f5bf-wzxl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-361c3a-5f8f84cb7c-p6c7t

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-48d74e-57f8487987-np4k8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-48d74e-77f759984c-j6jsk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-7kvjr
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-4ncwb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-rhhl4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-2t5gf

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

AddedInterface

Add eth0 [10.134.1.93/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-zhhhp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

ProbeError

Startup probe error: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

Unhealthy

Startup probe failed: Get "http://10.134.1.93:15021/healthz/ready": dial tcp 10.134.1.93:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-361c3a-openshift-default-6f67d958cf-g86hs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Unhealthy

Startup probe failed: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

ProbeError

Startup probe error: Get "http://10.134.1.93:15021/healthz/ready": dial tcp 10.134.1.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulDelete

Deleted pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-ffpz2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-361c3a-8648dbb499-fp9wn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-48d74e-openshift-default-5b465bf649-x9fwh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulDelete

Deleted pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-bh68g

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x10)

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-90cda9-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-90cda9-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-90cda9-openshift-default-57f8b6f957 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-90cda9-openshift-default-57f8b6f957

SuccessfulDelete

Deleted pod: e2e-extmod-b-90cda9-openshift-default-57f8b6f957-p9mqp

openshift-ingress

gateway_labeler_controller

e2e-mt-b8a8dc4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b8a8dc4c

openshift-ingress

deployment-controller

e2e-mt-b8a8dc4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b8a8dc4c-openshift-default-699557545 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-b8a8dc4c-openshift-default-699557545

SuccessfulCreate

Created pod: e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

openshift-ingress

multus

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

AddedInterface

Add eth0 [10.133.0.251/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b8a8dc4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b8a8dc4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b8a8dc4c-84fd646865 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg

AddedInterface

Add eth0 [10.134.1.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b8a8dc4c: serviceaccount "payload-processing-e2e-mt-b8a8dc4c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b8a8dc4c-84fd646865

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b8a8dc4c-84fd646865

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b8a8dc4c-84fd646865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b8a8dc4c: serviceaccount "payload-processing-e2e-mt-b8a8dc4c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

AddedInterface

Add eth0 [10.134.1.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b8a8dc4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b8a8dc4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Unhealthy

Readiness probe failed: Get "http://10.133.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

ProbeError

Readiness probe error: Get "http://10.133.0.250:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

ProbeError

Readiness probe error: Get "http://10.132.0.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Unhealthy

Readiness probe failed: Get "http://10.132.0.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Unhealthy

Readiness probe failed: Get "http://10.132.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Unhealthy

Readiness probe failed: Get "http://10.133.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Unhealthy

Readiness probe failed: Get "http://10.133.0.250:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

ProbeError

Readiness probe error: Get "http://10.133.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

ProbeError

Readiness probe error: Get "http://10.133.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

ProbeError

Readiness probe error: Get "http://10.132.0.220:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c

SuccessfulDelete

Deleted pod: e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-25f7a6-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-25f7a6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-mpjw7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-068756-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-068756-openshift-default-84f69c9cf5 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-068756-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-068756-openshift-default-84f69c9cf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-068756-openshift-default-84f69c9cf5-bb4qf

openshift-ingress

deployment-controller

e2e-extmod-a-ef5efe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-ef5efe-openshift-default-679746c7d9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ef5efe-openshift-default-679746c7d9

SuccessfulDelete

Deleted pod: e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ef5efe-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-843978-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-843978-openshift-default-7965f48c7f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-843978-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-843978-openshift-default-7965f48c7f

SuccessfulDelete

Deleted pod: e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-98xtx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-x5qtc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

Unhealthy

Startup probe failed: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

ProbeError

Startup probe error: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-e8a402-bd7d6fcbf-2tkh9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b8a8dc4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-b8a8dc4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-e8a402-openshift-default-869f646c59-qglhc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-e8a402-574cd44f6c-8dk2k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-357b30-6fbd545b95-vjnqk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-357b30-b4f4f9d7-dl8q8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-23f720-openshift-default-6c8d4f9ff5-vpdqd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-23f720-5684f8ccbc-gmk4g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-23f720-7cd49f58f-pmdm4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8962e9-59cc45b88f-mgc8z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8962e9-5bf5967579-6f6nc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-357b30-openshift-default-85bd97c49-nvq5j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulDelete

Deleted pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-5b6gt

openshift-ingress

kubelet

e2e-inf-b-8962e9-openshift-default-875c5bccf-7v7l8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-b8a8dc4c-84fd646865-m5zmg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b8a8dc4c-58df56c5d7-xw4q2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.1.97:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ef5efe-6cb8cb4479-49thw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ef5efe-5c765978c-k7pd7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ef5efe-openshift-default-679746c7d9-rlbdh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b8a8dc4c-openshift-default-699557545-57rbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-936529-f869b5f7f-5rhnq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-936529-5c8d858c85-p6stx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-035dac-openshift-default-6d5cb5658f-8kmlt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-035dac-77f9c676f5-8c5qm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-035dac-b889bf555-sgpxg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-936529-openshift-default-5578bccc97-9cw4k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-00d004-5dd8cc5b85-sgdv7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-00d004-768498cbc9-xv4lj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-00d004-openshift-default-56d4b77877-55tqt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-843978-667d5f8bdc-pzvrr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-843978-575d4f4c49-zgpk7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-843978-openshift-default-7965f48c7f-qk2dp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-e7561a-openshift-default-7598f89b79-m5rrm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e7561a-bb74f56f9-7mjlv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e7561a-6b449b78d5-vv6lv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-6416f0-openshift-default-6b984f4649-r6sn5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6416f0-7d89b6579f-rlqzp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6416f0-7f56ccb547-q7k5v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-068756-bdb7bcbbf-nnssk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-068756-8565b4cd8c-fpqt6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-068756-openshift-default-84f69c9cf5-77wtb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lwbxm

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lwbxm

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-k5zn8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-7kvjr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-xj4xk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-xj4xk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-ckslt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-7kvjr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-ckslt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-k5zn8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-740f09-56d9b5f5bc-r4xvn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-740f09-9f78f5f99-v5vz8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.197:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-740f09-openshift-default-786896ffcc-lmqlz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-90cda9-865d66bfbf-z4rc4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-90cda9-db6b5d58c-h4psk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-90cda9-openshift-default-57f8b6f957-b5jzx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-25f7a6-796cc7bf6f-5sb8z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-25f7a6-7dc85fc9-47fpl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-25f7a6-openshift-default-5fcc86d7c-smxns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-a6f2c0-openshift-default-7f47858fbf-ddl4s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a6f2c0-d46bdcf55-7nw8f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a6f2c0-6fd44bffcf-knx72

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-0e422b-openshift-default-8577f86657-c8pb7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0e422b-bd879bb75-hjpqg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-1aa18c-openshift-default-7d7f44f669-xz5m4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0e422b-56ccd9f6c5-l972k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1aa18c-7dccf58c79-vtkmx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1aa18c-7645874b6c-4vflv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-ed56b9-openshift-default-789859d697-5f5lv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ed56b9-7bc9f55c5-qjvr7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ed56b9-7ffc45fcd7-dhd7w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-4ncwb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4ncwb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 6 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-61e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-61e341-openshift-default-59d97476dc from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-61e341-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-61e341-openshift-default-59d97476dc

SuccessfulCreate

Created pod: e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-61e341-55d84b94dc-78ljx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-61e341-54bbc99d57-kls24

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

AddedInterface

Add eth0 [10.133.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-1e14d4-openshift-default-6dfdf7978c-62grh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-1e14d4-5b9c594759-v2rpz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-1e14d4-5f947fcf8f-blxl8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

ProbeError

Startup probe error: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

Unhealthy

Startup probe failed: Get "http://10.133.1.3:15021/healthz/ready": dial tcp 10.133.1.3:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-cmmcs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-61e341-openshift-default-59d97476dc-88q68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

multus

test-curl-6992-a1cce2

AddedInterface

Add eth0 [10.133.1.4/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-6992-a1cce2

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-6992-a1cce2

Created

Container created

opendatahub

kubelet

test-curl-6992-a1cce2

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-95ee26-677585b5b7-q7wrw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

kubelet

test-curl-6992-fefa6a

Created

Container created

opendatahub

kubelet

test-curl-6992-a1cce2

Killing

Stopping container test-curl-6992-a1cce2

opendatahub

multus

test-curl-6992-fefa6a

AddedInterface

Add eth0 [10.133.1.5/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-6992-fefa6a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-6992-fefa6a

Started

Container started

opendatahub

kubelet

test-curl-6992-fefa6a

Killing

Stopping container test-curl-6992-fefa6a

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-95ee26-5f96f56f79-2zqdd

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.51:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-95ee26-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-95ee26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-95ee26-openshift-default-66679d8f57 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-95ee26-openshift-default-66679d8f57

SuccessfulCreate

Created pod: e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

openshift-ingress

multus

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

AddedInterface

Add eth0 [10.133.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

Unhealthy

Startup probe failed: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-v8nzm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w2-95ee26-openshift-default-66679d8f57-5r6hx

ProbeError

Startup probe error: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-2t5gf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5bc884dd87-2t5gf

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5bc884dd87 from 5 to 4

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-14fcb6-openshift-default-568ddb87b9-tzf8f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-14fcb6-677f77795f-p496n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-14fcb6-86d4dd6867-cf6jg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-e3396f-openshift-default-5c76f8c6d5-jk8bx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e3396f-5b4fcb8f5-gjxrc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e3396f-6b84fd8ccc-9f6dk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-8032f3-openshift-default-765d774fdc-mhf7j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8032f3-86595cb565-rrbnr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-43be82-openshift-default-5df5fcbcb5-tmh89

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8032f3-f5b5684f9-42mvb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-43be82-5566f49cff-4jpxh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-43be82-649f8bfdff-8w6jf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-5514e5-b884d6445-hpkbk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-5514e5-cc9847d79-8jprz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-rhhl4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-5514e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-5514e5-openshift-default-7c9c979d5f from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f

SuccessfulCreate

Created pod: e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-5514e5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

AddedInterface

Add eth0 [10.133.1.7/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

ProbeError

Startup probe error: Get "http://10.133.1.7:15021/healthz/ready": dial tcp 10.133.1.7:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

Unhealthy

Startup probe failed: Get "http://10.133.1.7:15021/healthz/ready": dial tcp 10.133.1.7:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-6g4sw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w0-5514e5-openshift-default-dockercfg-7v87s); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w0-5514e5-openshift-default-7c9c979d5f-pbc9q

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-60a7443a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-60a7443a

openshift-ingress

deployment-controller

e2e-ait-60a7443a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-60a7443a-openshift-default-5f47b4f685 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-60a7443a-openshift-default-5f47b4f685

SuccessfulCreate

Created pod: e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

openshift-ingress

multus

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

AddedInterface

Add eth0 [10.133.1.8/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-60a7443a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-60a7443a-59485bdc55 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-60a7443a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-60a7443a-5467958647 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-60a7443a-5467958647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-60a7443a-5467958647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-60a7443a: serviceaccount "payload-processing-e2e-ait-60a7443a" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-60a7443a-5467958647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

openshift-ingress

multus

payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-60a7443a-59485bdc55

SuccessfulCreate

Created pod: payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

openshift-ingress

kubelet

payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-60a7443a-59485bdc55

FailedCreate

Error creating: pods "payload-processing-e2e-ait-60a7443a-59485bdc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-60a7443a: serviceaccount "payload-processing-e2e-ait-60a7443a" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-60a7443a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-60a7443a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Unhealthy

Readiness probe failed: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

ProbeError

Readiness probe error: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Unhealthy

Startup probe failed: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

ProbeError

Startup probe error: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-60a7443a-59485bdc55-8jjx5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60a7443a-5467958647-np56w

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-60a7443a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-60a7443a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Killing

Stopping container istio-proxy

opendatahub

kubelet

maas-controller-5597f6b9f6-blz6m

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-5597f6b9f6

SuccessfulDelete

Deleted pod: maas-controller-5597f6b9f6-blz6m

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-60a7443a-openshift-default-5f47b4f685-4flqv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

maas-controller-5597f6b9f6

SuccessfulCreate

Created pod: maas-controller-5597f6b9f6-zx498

opendatahub

multus

maas-controller-5597f6b9f6-zx498

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5597f6b9f6-zx498

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c"

opendatahub

kubelet

maas-controller-5597f6b9f6-zx498

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c" in 1.519s (1.519s including waiting). Image size: 200096245 bytes.

opendatahub

kubelet

maas-controller-5597f6b9f6-zx498

Started

Container started

opendatahub

kubelet

maas-controller-5597f6b9f6-zx498

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-gbd89

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

ProbeError

Startup probe error: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

Unhealthy

Startup probe failed: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused

opendatahub

maas-controller-5597f6b9f6-zx498_74b86be3-b6a2-4bb4-895b-8826db49b057

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5597f6b9f6-zx498_74b86be3-b6a2-4bb4-895b-8826db49b057 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

AddedInterface

Add eth0 [10.133.1.16/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

ProbeError

Startup probe error: Get "http://10.133.1.16:15021/healthz/ready": dial tcp 10.133.1.16:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

ProbeError

Startup probe error: Get "http://10.133.1.15:15021/healthz/ready": dial tcp 10.133.1.15:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Unhealthy

Startup probe failed: Get "http://10.133.1.15:15021/healthz/ready": dial tcp 10.133.1.15:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Unhealthy

Startup probe failed: Get "http://10.133.1.16:15021/healthz/ready": dial tcp 10.133.1.16:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

ProbeError

Startup probe error: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Unhealthy

Startup probe failed: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Unhealthy

Startup probe failed: Get "http://10.133.1.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

ProbeError

Startup probe error: Get "http://10.132.0.235:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

ProbeError

Startup probe error: Get "http://10.133.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Unhealthy

Startup probe failed: Get "http://10.133.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5597f6b9f6 from 1 to 0

opendatahub

replicaset-controller

maas-controller-5597f6b9f6

SuccessfulDelete

Deleted pod: maas-controller-5597f6b9f6-zx498
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

ProbeError

Startup probe error: Get "http://10.133.1.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

maas-controller-5597f6b9f6-zx498

Killing

Stopping container manager
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Unhealthy

Startup probe failed: Get "http://10.132.0.235:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

replicaset-controller

maas-controller-5597f6b9f6

SuccessfulCreate

Created pod: maas-controller-5597f6b9f6-cbcqg

opendatahub

kubelet

maas-controller-5597f6b9f6-cbcqg

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c"
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5597f6b9f6 from 0 to 1

opendatahub

multus

maas-controller-5597f6b9f6-cbcqg

AddedInterface

Add eth0 [10.133.1.17/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5597f6b9f6-cbcqg

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:da6f92cee69e3a552977bfbff258c11ce504c57d2e1c5f7237306cbd764a5c0c" in 313ms (313ms including waiting). Image size: 200096245 bytes.

opendatahub

kubelet

maas-controller-5597f6b9f6-cbcqg

Created

Container created

opendatahub

kubelet

maas-controller-5597f6b9f6-cbcqg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 9; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

AddedInterface

Add eth0 [10.134.1.136/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

Unhealthy

Startup probe failed: Get "http://10.134.1.136:15021/healthz/ready": dial tcp 10.134.1.136:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

ProbeError

Startup probe error: Get "http://10.134.1.136:15021/healthz/ready": dial tcp 10.134.1.136:15021: connect: connection refused body:

opendatahub

maas-controller-5597f6b9f6-cbcqg_48b60078-715b-4e9c-93aa-072e5df00166

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5597f6b9f6-cbcqg_48b60078-715b-4e9c-93aa-072e5df00166 became leader
(x5)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-5bc884dd87 from 9 to 10
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5bc884dd87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5bc884dd87-5wtjm

openshift-ingress

multus

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

AddedInterface

Add eth0 [10.133.1.19/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

ProbeError

Startup probe error: Get "http://10.133.1.19:15021/healthz/ready": dial tcp 10.133.1.19:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

Unhealthy

Startup probe failed: Get "http://10.133.1.19:15021/healthz/ready": dial tcp 10.133.1.19:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

Unhealthy

Startup probe failed: Get "http://10.133.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

ProbeError

Startup probe error: Get "http://10.133.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.Deployment llm/e2e-prio-pool-6b4a85cd-kserve

llm

deployment-controller

e2e-prio-pool-6b4a85cd-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.Service llm/e2e-prio-pool-6b4a85cd-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.ServiceAccount llm/e2e-prio-pool-6b4a85cd-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-6b4a85cd-epp-auth-rb

llm

replicaset-controller

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b

SuccessfulCreate

Created pod: e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.Secret llm/e2e-prio-pool-6b4a85cd-kserve-self-signed-certs

llm

deployment-controller

e2e-prio-pool-6b4a85cd-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c from 0 to 1

llm

replicaset-controller

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c

SuccessfulCreate

Created pod: e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.Role llm/e2e-prio-pool-6b4a85cd-epp-role

llm

multus

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

AddedInterface

Add eth0 [10.133.1.23/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.RoleBinding llm/e2e-prio-pool-6b4a85cd-epp-rb

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.Deployment llm/e2e-prio-pool-6b4a85cd-kserve-router-scheduler

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

Created v1.Service llm/e2e-prio-pool-6b4a85cd-epp-service

llm

multus

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

AddedInterface

Add eth0 [10.133.1.24/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

Created

Container created

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

Started

Container started

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Started

Container started

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Created

Container created

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-6b4a85cd-kserve-route
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-6b4a85cd-kserve-shadow-svc

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.547s (1.547s including waiting). Image size: 184206420 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Updated

Updated v1.Secret llm/e2e-prio-pool-6b4a85cd-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-6b4a85cd] is Ready

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

Killing

Stopping container main

llm

LLMInferenceServiceController

e2e-prio-pool-6b4a85cd

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-6b4a85cd-epp-auth-rb

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-f119d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-f119d1

openshift-ingress

deployment-controller

e2e-worker-single-main-f119d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-f119d1-openshift-default-5868b76b8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-f119d1-openshift-default-5868b76b8f

SuccessfulCreate

Created pod: e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-56f8b8b95b-mljbs

Unhealthy

Readiness probe failed: Get "https://10.133.1.23:8000/ready": context deadline exceeded

openshift-ingress

multus

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-f119d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-f119d1-848f686775 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-f119d1: serviceaccount "payload-processing-e2e-worker-single-main-f119d1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-f119d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-f119d1-848f686775

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-f119d1-848f686775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-f119d1: serviceaccount "payload-processing-e2e-worker-single-main-f119d1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-f119d1-848f686775

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

openshift-ingress

multus

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

AddedInterface

Add eth0 [10.133.1.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Unhealthy

Readiness probe failed: Get "http://10.132.0.238:15021/healthz/ready": read tcp 10.132.0.2:51302->10.132.0.238:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

ProbeError

Readiness probe error: Get "http://10.132.0.238:15021/healthz/ready": read tcp 10.132.0.2:51302->10.132.0.238:15021: read: connection reset by peer body:
(x6)

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

ProbeError

Startup probe error: Get "http://10.132.0.238:15021/healthz/ready": dial tcp 10.132.0.238:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Unhealthy

Startup probe failed: Get "http://10.132.0.238:15021/healthz/ready": dial tcp 10.132.0.238:15021: connect: connection refused
(x5)

llm

kubelet

e2e-prio-pool-6b4a85cd-kserve-router-scheduler-7d966f676c-ns2mg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-f119d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-f119d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677wtcqs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d5p5hj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-f119d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-f119d1-848f686775 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-f119d1-848f686775

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-f119d1-848f686775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-f119d1: serviceaccount "payload-processing-e2e-worker-single-main-f119d1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-f119d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-f119d1: serviceaccount "payload-processing-e2e-worker-single-main-f119d1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5d48499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

AddedInterface

Add eth0 [10.133.1.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

AddedInterface

Add eth0 [10.133.1.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-f119d1-848f686775

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-f119d1-7bb5dp7pc2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-f119d1-848f68677lv6zp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-single-main-f119d1-openshift-default-5868b76b8fnzjtk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

llm

kubelet

e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.Secret llm/e2e-same-id-a-f8e64488-kserve-self-signed-certs

llm

kubelet

e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

Created

Container created

llm

replicaset-controller

e2e-same-id-a-f8e64488-kserve-677b68f4b9

SuccessfulCreate

Created pod: e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-f8e64488-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.PodMonitor llm/e2e-same-id-a-f8e64488-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.PodMonitor llm/e2e-same-id-a-f8e64488-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.DestinationRule llm/e2e-same-id-a-f8e64488-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.HTTPRoute llm/e2e-same-id-a-f8e64488-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.Service llm/e2e-same-id-a-f8e64488-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Created

Created v1.Deployment llm/e2e-same-id-a-f8e64488-kserve

llm

kubelet

e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

deployment-controller

e2e-same-id-a-f8e64488-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-f8e64488-kserve-677b68f4b9 from 0 to 1

llm

multus

e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

AddedInterface

Add eth0 [10.133.1.31/23] from ovn-kubernetes
(x2)

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

Updated

Updated v1.Secret llm/e2e-same-id-a-f8e64488-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-f8e64488] is Ready

llm

replicaset-controller

e2e-same-id-b-f8e64488-kserve-d789bf9fc

SuccessfulCreate

Created pod: e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.Deployment llm/e2e-same-id-b-f8e64488-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.Secret llm/e2e-same-id-b-f8e64488-kserve-self-signed-certs

llm

deployment-controller

e2e-same-id-b-f8e64488-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-f8e64488-kserve-d789bf9fc from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.Service llm/e2e-same-id-b-f8e64488-kserve-workload-svc

llm

kubelet

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

multus

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

AddedInterface

Add eth0 [10.133.1.32/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-f8e64488-prometheus-scraping

llm

kubelet

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.DestinationRule llm/e2e-same-id-b-f8e64488-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.PodMonitor llm/e2e-same-id-b-f8e64488-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.HTTPRoute llm/e2e-same-id-b-f8e64488-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Created

Created v1.PodMonitor llm/e2e-same-id-b-f8e64488-kserve-llmisvc-engine
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

Updated

Updated v1.Secret llm/e2e-same-id-b-f8e64488-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-f8e64488] is Ready
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-f8e64488

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-f8e64488 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-f8e64488; safe to ignore if traffic splitting is planned
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-f8e64488

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-f8e64488 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-f8e64488; safe to ignore if traffic splitting is planned
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-4g2zz

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-5wtjm

ProbeError

Readiness probe error: Get "http://10.133.1.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-same-id-a-f8e64488-kserve-677b68f4b9-l2qzr

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-f8e64488-kserve-d789bf9fc-8chn5

Unhealthy

Readiness probe failed: Get "https://10.133.1.32:8000/ready": dial tcp 10.133.1.32:8000: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6f7bc57488 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-6f7bc57488-96bzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-6f7bc57488-96bzn

AddedInterface

Add eth0 [10.133.1.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-6f7bc57488-96bzn

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-6f7bc57488

SuccessfulCreate

Created pod: payload-pre-processing-6f7bc57488-96bzn

openshift-ingress

kubelet

payload-pre-processing-6f7bc57488-96bzn

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-qg68n

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qg68n

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7b49d5f75d from 0 to 1

openshift-ingress

kubelet

payload-processing-7b49d5f75d-mlqv7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-7b49d5f75d-mlqv7

AddedInterface

Add eth0 [10.133.1.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-7b49d5f75d

SuccessfulCreate

Created pod: payload-processing-7b49d5f75d-mlqv7

openshift-ingress

kubelet

payload-processing-7b49d5f75d-mlqv7

Started

Container started

openshift-ingress

kubelet

payload-processing-7b49d5f75d-mlqv7

Created

Container created

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-r6rdp

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-r6rdp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-7dbf4f4996 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-86f4845867

SuccessfulCreate

Created pod: payload-pre-processing-86f4845867-n579j

openshift-ingress

replicaset-controller

payload-processing-7dbf4f4996

SuccessfulCreate

Created pod: payload-processing-7dbf4f4996-66pcj

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-86f4845867 from 0 to 1

openshift-ingress

kubelet

payload-processing-7dbf4f4996-66pcj

Created

Container created

openshift-ingress

multus

payload-pre-processing-86f4845867-n579j

AddedInterface

Add eth0 [10.133.1.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-86f4845867-n579j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-7dbf4f4996-66pcj

Started

Container started

openshift-ingress

kubelet

payload-processing-7dbf4f4996-66pcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-86f4845867-n579j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-86f4845867-n579j

Started

Container started

openshift-ingress

multus

payload-processing-7dbf4f4996-66pcj

AddedInterface

Add eth0 [10.133.1.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-6f7bc57488

SuccessfulDelete

Deleted pod: payload-pre-processing-6f7bc57488-96bzn

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-7b49d5f75d from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-6f7bc57488 from 1 to 0

openshift-ingress

kubelet

payload-pre-processing-6f7bc57488-96bzn

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-7b49d5f75d

SuccessfulDelete

Deleted pod: payload-processing-7b49d5f75d-mlqv7

openshift-ingress

kubelet

payload-processing-7b49d5f75d-mlqv7

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-59ffk

Started

Container started

models-as-a-service

multus

payload-processing-external-model-5bcd7997-59ffk

AddedInterface

Add eth0 [10.133.1.40/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-59ffk

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-59ffk

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-59ffk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-59ffk

Killing

Stopping container payload-processing
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

ProbeError

Readiness probe error: Get "http://10.134.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-27twq

Unhealthy

Readiness probe failed: Get "http://10.134.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-single-main-593fe3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-593fe3-openshift-default-56579c548f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-593fe3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-593fe3

openshift-ingress

replicaset-controller

e2e-worker-single-main-593fe3-openshift-default-56579c548f

SuccessfulCreate

Created pod: e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

openshift-ingress

multus

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

AddedInterface

Add eth0 [10.133.1.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-593fe3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-593fe3-b5847f68f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-593fe3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-593fe3: serviceaccount "payload-processing-e2e-worker-single-main-593fe3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-593fe3-b5847f68f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-593fe3-b5847f68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-593fe3: serviceaccount "payload-processing-e2e-worker-single-main-593fe3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-593fe3-b5847f68f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

AddedInterface

Add eth0 [10.133.1.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

AddedInterface

Add eth0 [10.133.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

ProbeError

Readiness probe error: Get "http://10.133.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Unhealthy

Readiness probe failed: Get "http://10.133.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

ProbeError

Startup probe error: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Unhealthy

Startup probe failed: Get "http://10.133.1.56:15021/healthz/ready": dial tcp 10.133.1.56:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-593fe3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-593fe3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-593fe3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-593fe3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c4sq4d9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fvhh5t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-593fe3: serviceaccount "payload-processing-e2e-worker-single-main-593fe3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-593fe3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-593fe3-b5847f68f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-593fe3-b5847f68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-593fe3: serviceaccount "payload-processing-e2e-worker-single-main-593fe3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-593fe3-b5847f68f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-593fe3-664c484fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-593fe3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-593fe3-b5847f68f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

AddedInterface

Add eth0 [10.133.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

AddedInterface

Add eth0 [10.133.1.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-593fe3-b5847f68fd8795

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-593fe3-664c458jbc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-single-main-593fe3-openshift-default-56579c548fcn26x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-jpm5x

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-jpm5x

Killing

Stopping container manager

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-5nrjn
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-5nrjn

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-5nrjn

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-5nrjn

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-5nrjn

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-5nrjn_e7a0a781-476c-4d60-90f9-b81ff75680b8

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-5nrjn_e7a0a781-476c-4d60-90f9-b81ff75680b8 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

ProbeError

Readiness probe error: Get "http://10.132.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

Unhealthy

Readiness probe failed: Get "http://10.133.1.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-jr7g7

ProbeError

Readiness probe error: Get "http://10.133.1.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f5g6c

Unhealthy

Readiness probe failed: Get "http://10.132.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

ProbeError

Readiness probe error: Get "http://10.133.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

Unhealthy

Readiness probe failed: Get "http://10.132.0.235:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-f7fjr

ProbeError

Readiness probe error: Get "http://10.132.0.235:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-qmrsp

Unhealthy

Readiness probe failed: Get "http://10.133.1.15:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-m2dn7

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

Unhealthy

Readiness probe failed: Get "http://10.134.1.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-9tbj6

ProbeError

Readiness probe error: Get "http://10.134.1.136:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

Unhealthy

Readiness probe failed: Get "http://10.133.1.13:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5bc884dd87-gbd89

ProbeError

Readiness probe error: Get "http://10.133.1.13:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: