Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58 to ip-10-0-136-97.ec2.internal

ai-tenants

e2e-api-a-5c5686

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-5c5686: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-8fd232

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-8fd232: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-a-f3806a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-f3806a: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qqfrs to ip-10-0-133-253.ec2.internal

ai-tenants

e2e-api-b-4aa4e9

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-4aa4e9: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-714512

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-714512: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-cb05ae

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-cb05ae: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-api-b-d43409

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-d43409: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-autores-c59124

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-autores-c59124: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-explicit-b43332

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-explicit-b43332: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-850433

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-850433: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-955dc3

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-955dc3: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-c738e0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-c738e0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-d87781

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d87781: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-a-d9e067

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-a-d9e067: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-0db47e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-0db47e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-909268

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-909268: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-ac338d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-ac338d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-d4d8c2

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-d4d8c2: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-extmod-b-fdacdb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-extmod-b-fdacdb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-29d09b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-29d09b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-49d7e5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-49d7e5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-84f605

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-84f605: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-883a9e

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-883a9e: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-a-8ed55a

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-a-8ed55a: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-056a96

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-056a96: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-537652

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-537652: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-70c7d6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-70c7d6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-726205

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-726205: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-inf-b-7f20f7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-inf-b-7f20f7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-3437aa

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-3437aa: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-41e815

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-41e815: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-54f6d8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-54f6d8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-846492

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-846492: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-a-a43474

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-a-a43474: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-2af7b0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-2af7b0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-b6cd31

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-b6cd31: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-dda6df

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-dda6df: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-e37c9d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-e37c9d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-ipp-b-ea275f

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-ipp-b-ea275f: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-9f76b708

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-9f76b708: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-mt-c6e808d7

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-mt-c6e808d7: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-2df502

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-2df502: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-4ae722

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-4ae722: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-a-5d51a5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-a-5d51a5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-191362

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-191362: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-68738d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-68738d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-praxis-b-a19e67

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-praxis-b-a19e67: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w0-e62935

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w0-e62935: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w1-099583

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w1-099583: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w2-065de0

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w2-065de0: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w3-359f71

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w3-359f71: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-a-w4-9908e8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-a-w4-9908e8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w0-a07a90

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w0-a07a90: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w1-5c109b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w1-5c109b: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w2-7ef1b6

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w2-7ef1b6: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w3-2858fb

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w3-2858fb: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-shared-b-w4-20109d

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-shared-b-w4-20109d: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w0-fc9316

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w0-fc9316: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w1-b85343

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w1-b85343: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w2-4c61c8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w2-4c61c8: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w3-8e90c5

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w3-8e90c5: MaasTenantConfig is not available to restore revocation operands

ai-tenants

e2e-worker-w4-99bdb8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-worker-w4-99bdb8: MaasTenantConfig is not available to restore revocation operands

cert-manager

cert-manager-597b95cb84-4rsd4

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-4rsd4 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6 to ip-10-0-133-161.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-zvstf

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-zvstf to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-714512-openshift-default-8fb84d547-nv6vg to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm to ip-10-0-133-161.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-6l596

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-6l596 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-55fbbbf9dc-885tl

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-885tl to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8 to ip-10-0-133-161.ec2.internal

kuadrant-system

authorino-56bf98447d-nrnvg

Scheduled

Successfully assigned kuadrant-system/authorino-56bf98447d-nrnvg to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz to ip-10-0-133-161.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-9xgct

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-9xgct to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-zqd94

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-zqd94 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc to ip-10-0-133-253.ec2.internal

kuadrant-system

authorino-57f7f8659f-r2b47

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-r2b47 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-zhtvp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-zhtvp to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6 to ip-10-0-133-253.ec2.internal

kuadrant-system

authorino-6889cbd8c4-65g4t

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-65g4t to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b to ip-10-0-133-253.ec2.internal

kuadrant-system

authorino-6f5fd7bcdf-cdr4b

Scheduled

Successfully assigned kuadrant-system/authorino-6f5fd7bcdf-cdr4b to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd to ip-10-0-133-161.ec2.internal

kuadrant-system

authorino-6f6944bcdd-hzflm

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-hzflm to ip-10-0-133-161.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-b7f977d8-nps9f

Scheduled

Successfully assigned openshift-ingress/payload-processing-b7f977d8-nps9f to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-846db64bd8-6tnsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-846db64bd8-6tnsj to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-w99jj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w99jj to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5 to ip-10-0-133-161.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-kbvsh

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-kbvsh to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68 to ip-10-0-133-253.ec2.internal

models-as-a-service

payload-processing-external-model-f756c6b59-vm8d8

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-f756c6b59-vm8d8 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd to ip-10-0-136-97.ec2.internal

models-as-a-service

payload-processing-external-model-cdc4d9fcc-xrv2c

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-cdc4d9fcc-xrv2c to ip-10-0-133-161.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l2q2c to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-75b7db44c9-qzv2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-75b7db44c9-qzv2n to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-4m2w6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-4m2w6 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-w5m48

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-w5m48 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h to ip-10-0-133-161.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-wz9nt

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-wz9nt to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-b5668cfcb-2xmwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-b5668cfcb-2xmwb to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5 to ip-10-0-136-97.ec2.internal

models-as-a-service

payload-processing-external-model-bc94678d4-jrb5l

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bc94678d4-jrb5l to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5 to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-vrgzs

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-vrgzs to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89 to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-t297d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-t297d to ip-10-0-136-97.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-jk4jg

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-jk4jg to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b43332-openshift-default-5f447b8877-5k66w to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f3806a-openshift-default-9d7696669-ltd45 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6 to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-sc5jp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-sc5jp to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-rgwqf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-rgwqf to ip-10-0-133-161.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-89stt

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89stt to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-850433-openshift-default-7584745dd9-kld27 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-rcjbb to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw to ip-10-0-133-253.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-f4r7b

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f4r7b to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-r2qqg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-r2qqg to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-n4k2n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-n4k2n to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-msgxv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-msgxv to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-mnd7q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-mnd7q to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m to ip-10-0-136-97.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-m82cj

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-m82cj to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-lnm9s to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-kjlpp to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6 to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-hstf4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hstf4 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57 to ip-10-0-133-161.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-xnl45

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-xnl45 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-hn6jd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hn6jd to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8 to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-gknbx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-gknbx to ip-10-0-133-253.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-kxq2l

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-kxq2l to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dqqvx to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-dhv97

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dhv97 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7 to ip-10-0-133-253.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-cdvd9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cdvd9 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz to ip-10-0-133-161.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6mmrg

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-6mmrg to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd to ip-10-0-136-97.ec2.internal

models-as-a-service

payload-processing-external-model-865949b6c4-vjfgx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-865949b6c4-vjfgx to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8fzrc to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655 to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-7fw2m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-7fw2m to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-6q926

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-6q926 to ip-10-0-133-253.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-666b4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-666b4 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd to ip-10-0-133-161.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5lnf2 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt to ip-10-0-136-97.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-44ncj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-44ncj to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z to ip-10-0-133-161.ec2.internal

openshift-ingress

kube-auth-proxy-66c6b6454f-hlqrl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66c6b6454f-hlqrl to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9 to ip-10-0-133-253.ec2.internal

openshift-ingress

kube-auth-proxy-66c6b6454f-8nkg7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66c6b6454f-8nkg7 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9 to ip-10-0-133-253.ec2.internal

models-as-a-service

payload-processing-external-model-78576756d4-8czpf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-78576756d4-8czpf to ip-10-0-133-253.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-q2wkw to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx to ip-10-0-136-97.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wrm6m to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb to ip-10-0-133-161.ec2.internal

ai-tenants

e2e-api-b-1d29dd

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-b-1d29dd: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q to ip-10-0-133-161.ec2.internal

llm

e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

Scheduled

Successfully assigned llm/e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575 to ip-10-0-133-161.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kzsj7 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2 to ip-10-0-136-97.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-549f9d654fqchwv

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-549f9d654fqchwv to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd to ip-10-0-133-161.ec2.internal

models-as-a-service

payload-processing-external-model-76d5d774bc-r25fn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-76d5d774bc-r25fn to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr to ip-10-0-136-97.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-m2dbv to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw to ip-10-0-133-161.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-566cf6f9f5-zczkf to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g to ip-10-0-133-161.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-566cf6f9f5-tl898 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5 to ip-10-0-133-161.ec2.internal

llm

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Scheduled

Successfully assigned llm/e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs to ip-10-0-133-253.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-566cf6f9f5-2jxm6 to ip-10-0-133-253.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-hm874

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hm874 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l to ip-10-0-133-161.ec2.internal

opendatahub

test-curl-7618-e9313b

Scheduled

Successfully assigned opendatahub/test-curl-7618-e9313b to ip-10-0-133-253.ec2.internal

ai-tenants

e2e-api-a-27490b

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-27490b: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn to ip-10-0-136-97.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-2wkww

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wkww to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt to ip-10-0-136-97.ec2.internal

opendatahub

test-curl-7618-aa49f0

Scheduled

Successfully assigned opendatahub/test-curl-7618-aa49f0 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv to ip-10-0-133-161.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-gls75

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-gls75 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt to ip-10-0-133-161.ec2.internal

opendatahub

test-curl-7618-03110e

Scheduled

Successfully assigned opendatahub/test-curl-7618-03110e to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw to ip-10-0-136-97.ec2.internal

llm

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

Scheduled

Successfully assigned llm/e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6 to ip-10-0-133-253.ec2.internal

opendatahub

test-curl-7615-5304f0

Scheduled

Successfully assigned opendatahub/test-curl-7615-5304f0 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g to ip-10-0-133-253.ec2.internal

opendatahub

test-curl-7612-cca854

Scheduled

Successfully assigned opendatahub/test-curl-7612-cca854 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2 to ip-10-0-133-161.ec2.internal

openshift-jobset-operator

jobset-controller-manager-594589c6fc-nmgpm

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-594589c6fc-nmgpm to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td to ip-10-0-133-161.ec2.internal

models-as-a-service

payload-processing-external-model-6d94cc47fc-vkqbq

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6d94cc47fc-vkqbq to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn to ip-10-0-136-97.ec2.internal

llm

e2e-same-id-a-e3903940

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-e3903940

llm

e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

Scheduled

Successfully assigned llm/e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn to ip-10-0-136-97.ec2.internal

models-as-a-service

payload-processing-external-model-6d94cc47fc-4tc2p

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6d94cc47fc-4tc2p to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb to ip-10-0-133-161.ec2.internal

openshift-ingress

router-default-7df847f57-khf2f

Scheduled

Successfully assigned openshift-ingress/router-default-7df847f57-khf2f to ip-10-0-133-161.ec2.internal

openshift-ingress

router-default-7df847f57-khf2f

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7df847f57-khf2f

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz to ip-10-0-133-253.ec2.internal

llm

e2e-same-id-b-e3903940

ModelNameConflict

Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-e3903940

llm

e2e-same-id-b-e3903940

ModelNameConflictResolved

Model identity is no longer shared with any other MaaSModelRef in this namespace

llm

e2e-trlp-test-simulated-kserve-69b588897d-p94dw

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-p94dw to ip-10-0-133-161.ec2.internal

opendatahub

test-curl-7612-c144dd

Scheduled

Successfully assigned opendatahub/test-curl-7612-c144dd to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p to ip-10-0-133-161.ec2.internal

opendatahub

test-curl-7612-347ab8

Scheduled

Successfully assigned opendatahub/test-curl-7612-347ab8 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k to ip-10-0-133-161.ec2.internal

opendatahub

test-curl-7612-18acc3

Scheduled

Successfully assigned opendatahub/test-curl-7612-18acc3 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s to ip-10-0-136-97.ec2.internal

opendatahub

test-curl-7609-981f08

Scheduled

Successfully assigned opendatahub/test-curl-7609-981f08 to ip-10-0-136-97.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m to ip-10-0-133-161.ec2.internal

opendatahub

test-curl-7609-78cfcc

Scheduled

Successfully assigned opendatahub/test-curl-7609-78cfcc to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks to ip-10-0-136-97.ec2.internal

opendatahub

test-curl-7609-6f4f1c

Scheduled

Successfully assigned opendatahub/test-curl-7609-6f4f1c to ip-10-0-136-97.ec2.internal

opendatahub

odh-model-controller-769875db56-x5z9p

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-x5z9p to ip-10-0-133-161.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-hfkg4

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-hfkg4 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2 to ip-10-0-133-161.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-lfqwv

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-lfqwv to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6 to ip-10-0-136-97.ec2.internal

opendatahub

maas-controller-d9d5b6dc8-2n7g9

Scheduled

Successfully assigned opendatahub/maas-controller-d9d5b6dc8-2n7g9 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n to ip-10-0-136-97.ec2.internal

opendatahub

maas-controller-bc8c7d7fb-gcc5b

Scheduled

Successfully assigned opendatahub/maas-controller-bc8c7d7fb-gcc5b to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d to ip-10-0-136-97.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7 to ip-10-0-133-161.ec2.internal

ai-tenants

e2e-api-a-493ec8

APIKeyCleanupSkipped

Skipping API-key cleanup for AITenant ai-tenants/e2e-api-a-493ec8: MaasTenantConfig is not available to restore revocation operands

openshift-ingress

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r to ip-10-0-136-97.ec2.internal

opendatahub

maas-controller-bc8c7d7fb-b9ncb

Scheduled

Successfully assigned opendatahub/maas-controller-bc8c7d7fb-b9ncb to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6 to ip-10-0-136-97.ec2.internal

opendatahub

maas-controller-bc8c7d7fb-9crlh

Scheduled

Successfully assigned opendatahub/maas-controller-bc8c7d7fb-9crlh to ip-10-0-136-97.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-4zp9q

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-4zp9q to ip-10-0-133-253.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-p876r

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-p876r to ip-10-0-133-253.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-lrpvq

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-lrpvq to ip-10-0-133-253.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-2hwfp

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-2hwfp to ip-10-0-133-253.ec2.internal

opendatahub

ai-gateway-controller-77bbb667f4-ps8vw

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-77bbb667f4-ps8vw to ip-10-0-136-97.ec2.internal

opendatahub

ai-gateway-controller-5d8dddb676-cgqpk

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-cgqpk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9 to ip-10-0-133-161.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb to ip-10-0-133-161.ec2.internal

models-as-a-service

payload-processing-external-model-5db79bd7f6-kntx2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5db79bd7f6-kntx2 to ip-10-0-133-253.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-8n6rv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-8n6rv to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg to ip-10-0-133-253.ec2.internal

models-as-a-service

payload-processing-external-model-5bcd7997-x6mgv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bcd7997-x6mgv to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266 to ip-10-0-133-253.ec2.internal

models-as-a-service

payload-processing-external-model-5d5f4bbcf7-2ngxx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5d5f4bbcf7-2ngxx to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8 to ip-10-0-133-161.ec2.internal

models-as-a-service

payload-processing-external-model-5d5f4bbcf7-jtrbd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5d5f4bbcf7-jtrbd to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-537652-openshift-default-746478548f-zvwjz to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w to ip-10-0-136-97.ec2.internal

models-as-a-service

payload-processing-external-model-5d5f4bbcf7-mpcdh

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5d5f4bbcf7-mpcdh to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9 to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5 to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7 to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j to ip-10-0-133-161.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj to ip-10-0-136-97.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm to ip-10-0-133-161.ec2.internal

models-as-a-service

payload-processing-external-model-5db79bd7f6-9b7f6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5db79bd7f6-9b7f6 to ip-10-0-136-97.ec2.internal

openshift-ingress

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94 to ip-10-0-133-253.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh to ip-10-0-133-161.ec2.internal

openshift-ingress

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45 to ip-10-0-133-253.ec2.internal

openshift-ingress

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7 to ip-10-0-133-253.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7df847f57 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-7df847f57

SuccessfulCreate

Created pod: router-default-7df847f57-khf2f
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-7df847f57-khf2f

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7df847f57-khf2f

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-7df847f57-khf2f

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7df847f57-khf2f

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7df847f57-khf2f

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-7df847f57-khf2f

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7df847f57-khf2f

Created

Container created

openshift-ingress

kubelet

router-default-7df847f57-khf2f

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-8n6rv

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-8n6rv

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.756s (3.756s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-95cb67c75 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-8fzrc

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-95cb67c75

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-8fzrc

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-x97b6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.088s (12.088s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.346s (12.346s including waiting). Image size: 183555333 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-6mmrg

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6mmrg

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-6mmrg

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6mmrg

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6mmrg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.993s (2.993s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-6mmrg

Started

Container started

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-kbvsh

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-566cf6f9f5

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-566cf6f9f5-zczkf

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-566cf6f9f5-tl898

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

limitador-operator-controller-manager-5778bb4449-6mmrg_9ac1b3e6-766f-4ab5-835f-781b42269b79

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-6mmrg_9ac1b3e6-766f-4ab5-835f-781b42269b79 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-566cf6f9f5 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-566cf6f9f5

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-566cf6f9f5

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-566cf6f9f5-tl898

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-kbvsh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-kbvsh

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-kbvsh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.628s (1.628s including waiting). Image size: 167738465 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.864s (2.864s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.922s (2.922s including waiting). Image size: 273709574 bytes.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-wz9nt

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

install-p6ctm

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.06s (3.06s including waiting). Image size: 273709574 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-kbvsh_3a695a80-c781-41cf-8795-0e3493a3651f

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-kbvsh_3a695a80-c781-41cf-8795-0e3493a3651f became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 371ms (371ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-wz9nt

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-wz9nt

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-zczkf

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 375ms (375ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-2jxm6

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-566cf6f9f5-zczkf_8a8bad53-fb7b-4633-9def-4a5c2ed4169b

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-566cf6f9f5-zczkf_8a8bad53-fb7b-4633-9def-4a5c2ed4169b became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-wz9nt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.602s (2.602s including waiting). Image size: 190804149 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-566cf6f9f5-tl898

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 856ms (856ms including waiting). Image size: 273709574 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-wz9nt_8afb81e0-1eea-417d-abf9-11f853eacde9

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-wz9nt_8afb81e0-1eea-417d-abf9-11f853eacde9 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gls75

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-gls75

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-gls75

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-m82cj

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gls75

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.808s (2.808s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gls75

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-gls75

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-m82cj

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-m82cj

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-gls75_27ba5be5-eab4-4842-97c6-b8c4f6b8048d became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-m82cj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 7.298s (7.298s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-m82cj

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-m82cj

Created

Container created

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-m82cj_bbf1c3c0-fba8-4d56-a9e8-8b5bad8e3126

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-m82cj_bbf1c3c0-fba8-4d56-a9e8-8b5bad8e3126 became leader

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-jk4jg
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zvstf

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-jk4jg

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-zvstf

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jk4jg

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-zvstf
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zvstf

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zvstf

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-zvstf

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.126s (3.126s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jk4jg

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jk4jg

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jk4jg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.935s (4.935s including waiting). Image size: 342538866 bytes.

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-6l596

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-4rsd4

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-6l596

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6l596

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-597b95cb84-4rsd4

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-4rsd4

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-89stt

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-89stt

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-89stt

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-89stt

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-89stt

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-66c6b6454f from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

cert-manager

kubelet

cert-manager-597b95cb84-4rsd4

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.287s (3.287s including waiting). Image size: 309650901 bytes.

openshift-ingress

multus

kube-auth-proxy-66c6b6454f-hlqrl

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-4rsd4

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-4rsd4

Started

Container started

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-549f9d654f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-hlqrl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-549f9d654f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-549f9d654fqchwv

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-8nkg7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

kube-auth-proxy-66c6b6454f

SuccessfulCreate

Created pod: kube-auth-proxy-66c6b6454f-8nkg7

openshift-ingress

multus

kube-auth-proxy-66c6b6454f-8nkg7

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-66c6b6454f

SuccessfulCreate

Created pod: kube-auth-proxy-66c6b6454f-hlqrl

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fqchwv

Created

Container created

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-xnl45

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6l596

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.57s (3.57s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6l596

Created

Container created

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-549f9d654fqchwv

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fqchwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-6l596

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fqchwv

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xnl45

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-kxq2l

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-xnl45

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-r2b47

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-9xgct

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-8nkg7

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-8nkg7

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-kxq2l

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xnl45

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xnl45

Started

Container started

kuadrant-system

multus

limitador-limitador-7c9b87d574-kxq2l

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-hlqrl

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-hlqrl

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-hlqrl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.394s (2.394s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-56c6c9ddd5-9xgct

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-9xgct

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-r2b47

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-r2b47

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xnl45

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.342s (1.342s including waiting). Image size: 133379307 bytes.

openshift-ingress

kubelet

kube-auth-proxy-66c6b6454f-8nkg7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.373s (2.373s including waiting). Image size: 188904677 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-r2b47

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-9xgct

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-9xgct

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-kxq2l

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-kxq2l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.296s (2.296s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-kxq2l

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-9xgct

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.139s (2.139s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-r2b47

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-r2b47

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.984s (2.984s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-r2b47

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-r2b47

Killing

Stopping container authorino

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-lrpvq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-lrpvq

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-lrpvq

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-m82cj

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-m82cj

Killing

Stopping container manager

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-lrpvq

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-lrpvq

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-lrpvq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.331s (2.331s including waiting). Image size: 195729000 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xnl45

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-xnl45

opendatahub

kserve-module-controller-manager-7566cf5fc8-lrpvq_53f1780b-3ac3-4864-b1e2-98beb00948a4

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-lrpvq_53f1780b-3ac3-4864-b1e2-98beb00948a4 became leader

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-89stt_8961d0d8-456a-46f5-ae82-0a31335ef14c

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-89stt_8961d0d8-456a-46f5-ae82-0a31335ef14c became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

maas-controller-d9d5b6dc8

SuccessfulCreate

Created pod: maas-controller-d9d5b6dc8-2n7g9

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-d9d5b6dc8 from 0 to 1

opendatahub

multus

maas-controller-bc8c7d7fb-9crlh

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-d9d5b6dc8-2n7g9

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d"

opendatahub

replicaset-controller

maas-controller-bc8c7d7fb

SuccessfulCreate

Created pod: maas-controller-bc8c7d7fb-9crlh

opendatahub

multus

maas-controller-d9d5b6dc8-2n7g9

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-d9d5b6dc8-2n7g9

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d" in 2.668s (2.668s including waiting). Image size: 200095252 bytes.

opendatahub

kubelet

maas-controller-bc8c7d7fb-9crlh

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d" in 2.598s (2.598s including waiting). Image size: 200095252 bytes.

opendatahub

kubelet

maas-controller-d9d5b6dc8-2n7g9

Created

Container created

opendatahub

kubelet

maas-controller-d9d5b6dc8-2n7g9

Started

Container started

opendatahub

maas-controller-d9d5b6dc8-2n7g9_1e75c045-59d3-42d8-8b37-1eac192def89

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-d9d5b6dc8-2n7g9_1e75c045-59d3-42d8-8b37-1eac192def89 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-hm874

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hm874

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-hm874

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-2wkww

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2wkww

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2wkww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-2wkww

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2wkww

Created

Container created

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-4zp9q

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-4zp9q

opendatahub

multus

kserve-controller-manager-776cc66d47-2hwfp

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2hwfp

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-2hwfp

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4zp9q

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-hfkg4

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-hfkg4

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-hfkg4

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

odh-model-controller-769875db56-x5z9p

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-x5z9p

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-x5z9p

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-8n6rv

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Killing

Stopping container discovery

opendatahub

kubelet

maas-controller-d9d5b6dc8-2n7g9

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-d9d5b6dc8

SuccessfulDelete

Deleted pod: maas-controller-d9d5b6dc8-2n7g9

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-d9d5b6dc8 from 1 to 0

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-hfkg4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.021s (2.021s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4zp9q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.383s (2.383s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-x5z9p

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2hwfp

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.402s (2.402s including waiting). Image size: 247676581 bytes.

opendatahub

odh-model-controller-769875db56-x5z9p_0824dfd6-8692-45a2-bc54-b67e5ed7dbe1

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-x5z9p_0824dfd6-8692-45a2-bc54-b67e5ed7dbe1 became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4zp9q

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4zp9q

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-x5z9p

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-hfkg4

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-x5z9p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.647s (2.647s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-hfkg4

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2hwfp

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-2hwfp

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-2hwfp_77487999-2a57-4a5c-b55c-190513ce85d9

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-2hwfp_77487999-2a57-4a5c-b55c-190513ce85d9 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-4zp9q_77f79259-ccb1-4074-96f8-cef5b721cdeb

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-4zp9q_77f79259-ccb1-4074-96f8-cef5b721cdeb became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hm874

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hm874

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.33s (14.33s including waiting). Image size: 1089502687 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

Unhealthy

Readiness probe failed: Get "http://10.134.0.21:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-8n6rv

ProbeError

Readiness probe error: Get "http://10.134.0.21:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-hm874

Started

Container started

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-kkbb2"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-k9wgb"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-594589c6fc-nmgpm

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-594589c6fc

SuccessfulCreate

Created pod: jobset-controller-manager-594589c6fc-nmgpm

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-594589c6fc from 0 to 1

openshift-jobset-operator

kubelet

jobset-controller-manager-594589c6fc-nmgpm

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-594589c6fc-nmgpm

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.936s (3.936s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-594589c6fc-nmgpm

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-594589c6fc-nmgpm

Started

Container started

openshift-jobset-operator

jobset-controller-manager-594589c6fc-nmgpm_2903b824-6808-40b3-91f9-7606cb0fa7c1

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-594589c6fc-nmgpm_2903b824-6808-40b3-91f9-7606cb0fa7c1 became leader

opendatahub

maas-controller-bc8c7d7fb-9crlh_d33780f3-0964-4e77-96ba-b527ce7a482c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc8c7d7fb-9crlh_d33780f3-0964-4e77-96ba-b527ce7a482c became leader
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-hzflm

kuadrant-system

multus

authorino-6f6944bcdd-hzflm

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

kubelet

authorino-56bf98447d-nrnvg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

multus

authorino-56bf98447d-nrnvg

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56bf98447d from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-hzflm

kuadrant-system

replicaset-controller

authorino-56bf98447d

SuccessfulCreate

Created pod: authorino-56bf98447d-nrnvg

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-65g4t

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-65g4t

kuadrant-system

kubelet

authorino-6f6944bcdd-hzflm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6f6944bcdd-hzflm

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-hzflm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 793ms (793ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-hzflm

Started

Container started

kuadrant-system

kubelet

authorino-56bf98447d-nrnvg

Started

Container started

kuadrant-system

kubelet

authorino-56bf98447d-nrnvg

Created

Container created

kuadrant-system

kubelet

authorino-56bf98447d-nrnvg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 619ms (619ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-9xgct

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-9xgct

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-6f6944bcdd-hzflm

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-p876r

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p876r

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p876r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 277ms (277ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p876r

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-p876r

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-p876r

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-4zp9q

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-4zp9q

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-cgqpk

opendatahub

multus

ai-gateway-controller-5d8dddb676-cgqpk

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-cgqpk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-cgqpk

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-cgqpk

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-cgqpk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.589s (1.589s including waiting). Image size: 183979430 bytes.

opendatahub

ai-gateway-controller-5d8dddb676-cgqpk_83b5f589-799a-49f9-92b0-876d90bf3594

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-cgqpk_83b5f589-799a-49f9-92b0-876d90bf3594 became leader
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-885tl
(x5)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-4m2w6

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-4m2w6

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

multus

payload-processing-55fbbbf9dc-885tl

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-4m2w6

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-885tl

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-885tl

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-885tl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-4m2w6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-4m2w6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.873s (1.873s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-4m2w6

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-885tl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.954s (1.954s including waiting). Image size: 125353963 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-p876r_86c98740-8ac9-4405-a4a8-3b9162e3dfaf

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-p876r_86c98740-8ac9-4405-a4a8-3b9162e3dfaf became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-77bbb667f4 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-77bbb667f4

SuccessfulCreate

Created pod: ai-gateway-controller-77bbb667f4-ps8vw

opendatahub

kubelet

ai-gateway-controller-77bbb667f4-ps8vw

Created

Container created

opendatahub

multus

ai-gateway-controller-77bbb667f4-ps8vw

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-77bbb667f4-ps8vw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 304ms (304ms including waiting). Image size: 183979430 bytes.

opendatahub

kubelet

ai-gateway-controller-77bbb667f4-ps8vw

Started

Container started

opendatahub

kubelet

ai-gateway-controller-77bbb667f4-ps8vw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-cgqpk

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-cgqpk

Killing

Stopping container manager

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.086s (1.086s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-mnz29

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-q2wkw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.263s (1.263s including waiting). Image size: 98346788 bytes.

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-p94dw

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 345ms (345ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

Started

Container started

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-p94dw

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-p94dw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-p94dw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 203ms (203ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-p94dw

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-p94dw

Started

Container started

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 175ms (175ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-lfqwv

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8prfj7

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lfqwv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

opendatahub

ai-gateway-controller-77bbb667f4-ps8vw_1f0b7197-ac90-4a9c-85e6-ca4b6fec20ab

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-77bbb667f4-ps8vw_1f0b7197-ac90-4a9c-85e6-ca4b6fec20ab became leader

llm

multus

echo-simulator-kserve-64b6f8f96c-lfqwv

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lfqwv

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lfqwv

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lfqwv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.549s (1.549s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-fj4kk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 220ms (220ms including waiting). Image size: 98346788 bytes.
(x2)

opendatahub

kubelet

maas-controller-bc8c7d7fb-9crlh

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

opendatahub

kubelet

maas-controller-bc8c7d7fb-9crlh

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d" in 449ms (449ms including waiting). Image size: 200095252 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
(x2)

opendatahub

kubelet

maas-controller-bc8c7d7fb-9crlh

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-bc8c7d7fb-9crlh

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 182ms (182ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-rcjbb

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-dqqvx

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-rcjbb

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 1 to 3

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-dqqvx

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.601s (2.601s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.005s (3.005s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Started

Container started

opendatahub

maas-controller-bc8c7d7fb-9crlh_4547f461-afb9-460d-8bde-83f7c07aeb22

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc8c7d7fb-9crlh_4547f461-afb9-460d-8bde-83f7c07aeb22 became leader

kuadrant-system

multus

authorino-6f5fd7bcdf-cdr4b

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f5fd7bcdf-cdr4b

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6f5fd7bcdf

SuccessfulCreate

Created pod: authorino-6f5fd7bcdf-cdr4b

kuadrant-system

kubelet

authorino-6f5fd7bcdf-cdr4b

Started

Container started

kuadrant-system

kubelet

authorino-6f5fd7bcdf-cdr4b

Created

Container created

kuadrant-system

kubelet

authorino-6f5fd7bcdf-cdr4b

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 575ms (575ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-56bf98447d from 1 to 0

kuadrant-system

replicaset-controller

authorino-56bf98447d

SuccessfulDelete

Deleted pod: authorino-56bf98447d-nrnvg

kuadrant-system

kubelet

authorino-56bf98447d-nrnvg

Killing

Stopping container authorino
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-lnm9s

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-5lnf2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-kjlpp

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-lnm9s

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-kjlpp

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-5lnf2

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-a96a129b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a96a129b

openshift-ingress

replicaset-controller

e2e-ait-a96a129b-openshift-default-7d4578c85f

SuccessfulCreate

Created pod: e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

openshift-ingress

replicaset-controller

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777

SuccessfulCreate

Created pod: e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

openshift-ingress

deployment-controller

e2e-migrate-b4cc5943-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-c600f063-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c600f063-openshift-default-5674c5ddb9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-b4cc5943-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b4cc5943-gw

openshift-ingress

gateway_labeler_controller

e2e-ait-c600f063

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c600f063

openshift-ingress

deployment-controller

e2e-ait-a96a129b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a96a129b-openshift-default-7d4578c85f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c600f063-openshift-default-5674c5ddb9

SuccessfulCreate

Created pod: e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

openshift-ingress

replicaset-controller

e2e-ait-19590f89-openshift-default-6fc56f545f

SuccessfulCreate

Created pod: e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

openshift-ingress

deployment-controller

e2e-ait-19590f89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-19590f89-openshift-default-6fc56f545f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-19590f89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-19590f89

openshift-ingress

multus

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c600f063

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c600f063

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c600f063-66b9c85fc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c600f063-66b9c85fc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c600f063-66b9c85fc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c600f063-66b9c85fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c600f063: serviceaccount "payload-processing-e2e-ait-c600f063" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c600f063: serviceaccount "payload-processing-e2e-ait-c600f063" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b4cc5943

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b4cc5943-854759774c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b4cc5943-867dbdb575

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b4cc5943-854759774c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b4cc5943-867dbdb575

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b4cc5943-867dbdb575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b4cc5943: serviceaccount "payload-processing-e2e-migrate-b4cc5943" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b4cc5943

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b4cc5943-867dbdb575 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b4cc5943-854759774c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b4cc5943-854759774c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b4cc5943: serviceaccount "payload-processing-e2e-migrate-b4cc5943" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a96a129b-5c74588b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

openshift-ingress

multus

payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a96a129b-75cd9874fc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a96a129b-75cd9874fc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a96a129b-75cd9874fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a96a129b: serviceaccount "payload-processing-e2e-ait-a96a129b" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a96a129b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a96a129b-5c74588b59 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a96a129b-5c74588b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a96a129b-5c74588b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a96a129b: serviceaccount "payload-processing-e2e-ait-a96a129b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a96a129b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a96a129b-75cd9874fc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-derive-e3e6ed37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e3e6ed37

openshift-ingress

deployment-controller

e2e-derive-e3e6ed37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e3e6ed37-openshift-default-8577b478b5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-19590f89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-19590f89-c669fd79c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-19590f89-c669fd79c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-19590f89-c669fd79c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-19590f89-c669fd79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-19590f89: serviceaccount "payload-processing-e2e-ait-19590f89" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-19590f89-75b6594799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-19590f89-75b6594799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-19590f89: serviceaccount "payload-processing-e2e-ait-19590f89" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-19590f89-75b6594799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

openshift-ingress

replicaset-controller

e2e-derive-e3e6ed37-openshift-default-8577b478b5

SuccessfulCreate

Created pod: e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-19590f89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-19590f89-75b6594799 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e3e6ed37: serviceaccount "payload-processing-e2e-derive-e3e6ed37" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e3e6ed37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e3e6ed37-668988b567

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e3e6ed37-668988b567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e3e6ed37: serviceaccount "payload-processing-e2e-derive-e3e6ed37" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e3e6ed37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e3e6ed37-668988b567 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e3e6ed37-668988b567

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b4cc5943-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b4cc5943-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a96a129b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a96a129b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:49058->10.132.0.61:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:49058->10.132.0.61:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Created

Container created

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-e3e6ed37-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-e3e6ed37-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-b4cc5943-867dbdb575-xqjtn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b4cc5943-854759774c-7h5ff

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b4cc5943-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-b4cc5943-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c600f063-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a96a129b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-c600f063-66b9c85fc5-p9rsv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c600f063-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a96a129b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c600f063-6dcbb79fc9-bhfjz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-19590f89-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-19590f89-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-19590f89-c669fd79c-7z6kq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19590f89-75b6594799-w8kj5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Started

Container started

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-99bdb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-99bdb8

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 0 to 1

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-8e90c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-8e90c5

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a96a129b-5c74588b59-fg7rq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ait-a96a129b-75cd9874fc-5896v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-19590f89-openshift-default-6fc56f545f-ccltk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-c600f063-openshift-default-5674c5ddb9-2zr4z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-a96a129b-openshift-default-7d4578c85f-nwrmz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-fc9316

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-fc9316

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch
(x5)

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-b4cc5943-gw-openshift-default-6fd9d74777-7r8hv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-99bdb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-99bdb8-84d64f99f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-4c61c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-4c61c8

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-99bdb8: serviceaccount "payload-processing-e2e-worker-w4-99bdb8" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-99bdb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

Created

Container created

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-99bdb8: serviceaccount "payload-processing-e2e-worker-w4-99bdb8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-8e90c5: serviceaccount "payload-processing-e2e-worker-w3-8e90c5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-8e90c5-75f87f7845

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-8e90c5-75f87f7845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-8e90c5: serviceaccount "payload-processing-e2e-worker-w3-8e90c5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-8e90c5-75f87f7845

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-8e90c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-8e90c5-75f87f7845 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-8e90c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-8e90c5-865b959567 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-e3e6ed37-668988b567-snsh2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e3e6ed37-7bdd4b86f5-bbvc6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-fc9316

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-fc9316: serviceaccount "payload-processing-e2e-worker-w0-fc9316" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-fc9316

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-fc9316: serviceaccount "payload-processing-e2e-worker-w0-fc9316" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-4c61c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-4c61c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-4c61c8-577656bb65 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-4c61c8: serviceaccount "payload-processing-e2e-worker-w2-4c61c8" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-4c61c8-577656bb65

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-4c61c8-577656bb65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-4c61c8: serviceaccount "payload-processing-e2e-worker-w2-4c61c8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-4c61c8-577656bb65

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-e3e6ed37-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-e3e6ed37-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-b85343

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-b85343

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-e3e6ed37-openshift-default-8577b478b5-vts9z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-b85343

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-b85343-657658f49f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-b85343

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-b85343-69fbff6447 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b85343-657658f49f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-b85343-657658f49f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b85343: serviceaccount "payload-processing-e2e-worker-w1-b85343" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b85343: serviceaccount "payload-processing-e2e-worker-w1-b85343" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b85343-657658f49f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-wz9nt

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-wz9nt

Pulled

Container image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-wz9nt

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w4-99bdb8\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w4-99bdb8\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x12)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w1-b85343\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x13)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w1-b85343\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x12)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w0-fc9316\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w0-fc9316\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dmaas-default-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dmaas-default-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dopenshift-ai-inference\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Dopenshift-ai-inference\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

kuadrant-system

dns-operator-controller-manager-8557cbdb84-wz9nt_bfb3c89e-dcb3-4864-a64d-638c9706af7d

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-wz9nt_bfb3c89e-dcb3-4864-a64d-638c9706af7d became leader

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Killing

Container istio-proxy failed startup probe, will be restarted

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Killing

Container istio-proxy failed startup probe, will be restarted
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Ddata-science-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3Ddata-science-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w4-99bdb8\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w3-8e90c5\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w4-99bdb8\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w3-8e90c5\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w2-4c61c8\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=gateway.networking.k8s.io%2Fgateway-name%3De2e-worker-w2-4c61c8\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Started

Container started
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 1 to 2

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-cdc4d9fcc from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-cdc4d9fcc

SuccessfulCreate

Created pod: payload-processing-external-model-cdc4d9fcc-xrv2c

models-as-a-service

multus

payload-processing-external-model-cdc4d9fcc-xrv2c

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-cdc4d9fcc-xrv2c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-cdc4d9fcc

FailedCreate

Error creating: pods "payload-processing-external-model-cdc4d9fcc-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-cdc4d9fcc-xrv2c

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-cdc4d9fcc-xrv2c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-865949b6c4 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-865949b6c4

SuccessfulCreate

Created pod: payload-processing-external-model-865949b6c4-vjfgx

models-as-a-service

multus

payload-processing-external-model-865949b6c4-vjfgx

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-865949b6c4-vjfgx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-865949b6c4-vjfgx

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-865949b6c4-vjfgx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-7fw2m

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 1 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-sc5jp

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-n4k2n

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6cc458d887-rgwqf

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n4k2n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rgwqf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n4k2n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n4k2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sc5jp

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-sc5jp

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7fw2m

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7fw2m

Created

Container created

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sc5jp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sc5jp

Created

Container created

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-7fw2m

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rgwqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7fw2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-n4k2n

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rgwqf

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-rgwqf

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-cdc4d9fcc

SuccessfulDelete

Deleted pod: payload-processing-external-model-cdc4d9fcc-xrv2c

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-cdc4d9fcc from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-cdc4d9fcc-xrv2c

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n4k2n

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rgwqf

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sc5jp

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sc5jp

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n4k2n

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rgwqf

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7fw2m

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7fw2m

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 2 to 4

models-as-a-service

replicaset-controller

payload-processing-external-model-6d94cc47fc

SuccessfulCreate

Created pod: payload-processing-external-model-6d94cc47fc-vkqbq

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-vkqbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6d94cc47fc-vkqbq

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-vkqbq

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-vkqbq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-865949b6c4 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-865949b6c4

SuccessfulDelete

Deleted pod: payload-processing-external-model-865949b6c4-vjfgx

models-as-a-service

kubelet

payload-processing-external-model-865949b6c4-vjfgx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 4 to 5

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-f756c6b59 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-f756c6b59-vm8d8

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-f756c6b59-vm8d8

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-f756c6b59-vm8d8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-f756c6b59-vm8d8

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-f756c6b59

SuccessfulCreate

Created pod: payload-processing-external-model-f756c6b59-vm8d8

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6d94cc47fc from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6d94cc47fc

SuccessfulDelete

Deleted pod: payload-processing-external-model-6d94cc47fc-vkqbq

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-vkqbq

Killing

Stopping container payload-processing
(x8)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Started

Container started

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Created

Container created

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

replicaset-controller

payload-processing-external-model-6d94cc47fc

SuccessfulCreate

Created pod: payload-processing-external-model-6d94cc47fc-4tc2p
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6d94cc47fc from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-6d94cc47fc-4tc2p

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 5 to 6

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Unhealthy

Readiness probe failed: Get "https://10.132.0.58:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-f756c6b59-vm8d8

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-external-model-dockercfg-xtc2k); attempting to pull the image may not succeed.

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

Killing

Stopping container payload-processing
(x4)

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-b39c24993f8f" not found
(x4)

models-as-a-service

kubelet

payload-processing-external-model-6d94cc47fc-4tc2p

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 4 to 6

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 6 to 10

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Created

Container created

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

Created

Container created

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 6 to 10

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

ProbeError

Startup probe error: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

Unhealthy

Startup probe failed: Get "http://10.132.0.119:15021/healthz/ready": dial tcp 10.132.0.119:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Unhealthy

Liveness probe failed: Get "https://10.132.0.58:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-mt-9f76b708

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-9f76b708

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-mt-9f76b708-openshift-default-7664fdbcd9

SuccessfulCreate

Created pod: e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

openshift-ingress

deployment-controller

e2e-mt-9f76b708-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-9f76b708-openshift-default-7664fdbcd9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

ProbeError

Readiness probe error: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Unhealthy

Readiness probe failed: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

openshift-ingress

multus

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f76b708-6868dbb7f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9f76b708

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9f76b708-6868dbb7f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9f76b708

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f76b708-6868dbb7f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9f76b708-6868dbb7f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f76b708: serviceaccount "payload-processing-e2e-mt-9f76b708" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f76b708: serviceaccount "payload-processing-e2e-mt-9f76b708" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Unhealthy

Readiness probe failed: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

ProbeError

Readiness probe error: Get "http://10.132.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Unhealthy

Readiness probe failed: Get "http://10.132.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-wrm6m

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Created

Container created

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Started

Container started

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.138s (4.138s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wrm6m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

Created

Container created

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

ProbeError

Startup probe error: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

Unhealthy

Startup probe failed: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 8 to 9

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Unhealthy

Liveness probe failed: Get "https://10.132.0.58:8000/health": context deadline exceeded

openshift-ingress

deployment-controller

e2e-api-a-8fd232-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8fd232-openshift-default-85b6db77c9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-8fd232

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8fd232

openshift-ingress

replicaset-controller

e2e-api-a-8fd232-openshift-default-85b6db77c9

SuccessfulCreate

Created pod: e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

openshift-ingress

multus

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8fd232-fd8d9c969

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8fd232-fd8d9c969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8fd232: serviceaccount "payload-processing-e2e-api-a-8fd232" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8fd232-fd8d9c969

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8fd232

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8fd232-fd8d9c969 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8fd232: serviceaccount "payload-processing-e2e-api-a-8fd232" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8fd232

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9f76b708-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-9f76b708-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

Started

Container started

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

Created

Container created

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Started

Container started

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-714512-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-714512-openshift-default-8fb84d547 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-714512-openshift-default-8fb84d547

SuccessfulCreate

Created pod: e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

openshift-ingress

gateway_labeler_controller

e2e-api-b-714512

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-714512

openshift-ingress

multus

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-714512-b95cf9d6f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p
(x2)

openshift-ingress

kubelet

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-714512

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-714512-b95cf9d6f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-714512-8555656587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-714512-8555656587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-714512: serviceaccount "payload-processing-e2e-api-b-714512" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-714512

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-714512-8555656587 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-714512-b95cf9d6f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-714512-b95cf9d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-714512: serviceaccount "payload-processing-e2e-api-b-714512" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-714512-8555656587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7618-e9313b

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7618-e9313b

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

opendatahub

kubelet

test-curl-7618-e9313b

Started

Container started

opendatahub

kubelet

test-curl-7618-e9313b

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.492s (2.492s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7618-e9313b

Created

Container created

opendatahub

kubelet

test-curl-7618-e9313b

Killing

Stopping container test-curl-7618-e9313b

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-714512-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-714512-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8fd232-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8fd232-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-a-5c5686-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5c5686-openshift-default-7d47fd95b7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-5c5686

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5c5686

openshift-ingress

replicaset-controller

e2e-api-a-5c5686-openshift-default-7d47fd95b7

SuccessfulCreate

Created pod: e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

openshift-ingress

multus

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8fd232-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8fd232-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5c5686: serviceaccount "payload-processing-e2e-api-a-5c5686" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5c5686

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5c5686

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5c5686-77767d966f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5c5686-77767d966f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5c5686-77767d966f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5c5686: serviceaccount "payload-processing-e2e-api-a-5c5686" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5c5686-77767d966f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-hhf7b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-xfdm5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8fd232-6b9789dc4c-zdknn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-8fd232-fd8d9c969-l25qk

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f76b708: serviceaccount "payload-processing-e2e-mt-9f76b708" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f76b708-6868dbb7f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7
(x2)

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-9f76b708-6868dbb7f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-9f76b708-6868dbb7f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-9f76b708: serviceaccount "payload-processing-e2e-mt-9f76b708" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-9f76b708

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-9f76b708

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-9f76b708-6868dbb7f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-8fd232-openshift-default-85b6db77c9-tcxjh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-714512-b95cf9d6f-92z4p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-714512-8555656587-cqcpx

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-4aa4e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4aa4e9

openshift-ingress

deployment-controller

e2e-api-b-4aa4e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4aa4e9-openshift-default-8576d9c975 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-714512-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-714512-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4aa4e9-646cc5868f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4aa4e9-646cc5868f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4aa4e9: serviceaccount "payload-processing-e2e-api-b-4aa4e9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4aa4e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4aa4e9-646cc5868f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4aa4e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4aa4e9-6c74487659 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4aa4e9: serviceaccount "payload-processing-e2e-api-b-4aa4e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4aa4e9-646cc5868f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

ProbeError

Readiness probe error: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Unhealthy

Readiness probe failed: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-qqfrs

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.108s (3.108s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7618-03110e

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7618-03110e

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7618-03110e

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.044s (3.044s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7618-03110e

Created

Container created

opendatahub

kubelet

test-curl-7618-03110e

Started

Container started

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-714512-openshift-default-8fb84d547-nv6vg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-7618-03110e

Killing

Stopping container test-curl-7618-03110e

openshift-ingress

replicaset-controller

e2e-api-a-f3806a-openshift-default-9d7696669

SuccessfulCreate

Created pod: e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

openshift-ingress

deployment-controller

e2e-api-a-f3806a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f3806a-openshift-default-9d7696669 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-f3806a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f3806a

openshift-ingress

multus

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f3806a: serviceaccount "payload-processing-e2e-api-a-f3806a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f3806a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f3806a-5d87d748ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f3806a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f3806a-6c57db5c87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f3806a-6c57db5c87

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f3806a-6c57db5c87

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f3806a-6c57db5c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f3806a: serviceaccount "payload-processing-e2e-api-a-f3806a" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4aa4e9-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm

Created

Container created

openshift-ingress

deployment-controller

e2e-api-b-4aa4e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4aa4e9-openshift-default-8576d9c975 from 1 to 4

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

Started

Container started

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

Created

Container created

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

Started

Container started

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5c5686-7fb997cfdc-7dllb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

Started

Container started

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-5c5686-77767d966f-pkt5l

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-41e815-openshift-default-649b9cbc9

SuccessfulCreate

Created pod: e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

openshift-ingress

deployment-controller

e2e-ipp-a-41e815-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-41e815-openshift-default-649b9cbc9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-41e815

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-41e815

openshift-ingress

multus

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5c5686-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5c5686-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-41e815

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-41e815-75758b5ff7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-41e815-75758b5ff7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-41e815-75758b5ff7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-41e815-75758b5ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-41e815: serviceaccount "payload-processing-e2e-ipp-a-41e815" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-41e815

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-41e815: serviceaccount "payload-processing-e2e-ipp-a-41e815" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4aa4e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4aa4e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-mt-9f76b708-6868dbb7f7-dvns7

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-493ec8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-493ec8

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-9f76b708-867f4ccfb7-sr2gj

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-a-493ec8-openshift-default-76b589f5c7

SuccessfulCreate

Created pod: e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

openshift-ingress

multus

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-493ec8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-493ec8-openshift-default-76b589f5c7 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-5c5686-openshift-default-7d47fd95b7-tvx57

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-493ec8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-493ec8-67976d6b7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-493ec8-67976d6b7f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-493ec8-67976d6b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-493ec8: serviceaccount "payload-processing-e2e-api-a-493ec8" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-493ec8: serviceaccount "payload-processing-e2e-api-a-493ec8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-493ec8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-493ec8-5c8db9755f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-493ec8-67976d6b7f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4aa4e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4aa4e9-6c74487659-vrcnf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4aa4e9-646cc5868f-rdgks

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4aa4e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-41e815-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-41e815-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9

SuccessfulCreate

Created pod: e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

openshift-ingress

deployment-controller

e2e-api-b-cb05ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cb05ae-openshift-default-7bc99bd8f9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-cb05ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cb05ae

openshift-ingress

multus

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-9f76b708-openshift-default-7664fdbcd9-p8ms5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-27490b-openshift-default-6bc89c8cbf

SuccessfulCreate

Created pod: e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

openshift-ingress

deployment-controller

e2e-api-a-27490b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-27490b-openshift-default-6bc89c8cbf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cb05ae-67dc695747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cb05ae-67dc695747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cb05ae-67dc695747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cb05ae: serviceaccount "payload-processing-e2e-api-b-cb05ae" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cb05ae-5d86698897

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cb05ae-5d86698897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cb05ae: serviceaccount "payload-processing-e2e-api-b-cb05ae" not found

openshift-ingress

gateway_labeler_controller

e2e-api-a-27490b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-27490b

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cb05ae-5d86698897

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cb05ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cb05ae-5d86698897 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cb05ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cb05ae-67dc695747 from 0 to 1

openshift-ingress

multus

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9

Created

Container created

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

openshift-ingress

multus

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-4aa4e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4aa4e9-openshift-default-8576d9c975 from 4 to 7

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4aa4e9-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-4aa4e9-openshift-default-8576d9c975

SuccessfulCreate

Created pod: e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

Started

Container started

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

Created

Container created

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

Started

Container started

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-27490b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-27490b-5d5c658567 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-27490b-5d5c658567

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-27490b-5d5c658567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-27490b: serviceaccount "payload-processing-e2e-api-a-27490b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-27490b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-27490b-df699c78c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-27490b-df699c78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-27490b-df699c78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-27490b: serviceaccount "payload-processing-e2e-api-a-27490b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-27490b-df699c78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655
(x5)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-27490b-5d5c658567

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-m2dbv

Unhealthy

Readiness probe failed: Get "https://10.134.0.36:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-58ddf479cf-kftzb

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

ProbeError

Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-75758b5ff7-r6ljl

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

Unhealthy

Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-4aa4e9-openshift-default-dockercfg-fkwlw); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-w5blk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-4aa4e9-openshift-default-dockercfg-fkwlw); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-n5t4b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-zmrb2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-9hwr5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pwdtc

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3437aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3437aa

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-pf6d6

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-4aa4e9-openshift-default-8576d9c975-767wp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-3437aa-openshift-default-67b59dfbf

SuccessfulCreate

Created pod: e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

openshift-ingress

deployment-controller

e2e-ipp-a-3437aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3437aa-openshift-default-67b59dfbf from 0 to 1

openshift-ingress

multus

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3437aa: serviceaccount "payload-processing-e2e-ipp-a-3437aa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3437aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3437aa-5ff55ff675 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3437aa-5ff55ff675

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3437aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3437aa-5ff55ff675

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3437aa-5ff55ff675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3437aa: serviceaccount "payload-processing-e2e-ipp-a-3437aa" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f3806a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f3806a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-d43409-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d43409-openshift-default-6ccc9fc775 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-d43409

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d43409

openshift-ingress

replicaset-controller

e2e-api-b-d43409-openshift-default-6ccc9fc775

SuccessfulCreate

Created pod: e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76
(x5)

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-41e815: serviceaccount "payload-processing-e2e-ipp-a-41e815" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-41e815

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-41e815-6bf7cffc54

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-41e815-6bf7cffc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-41e815: serviceaccount "payload-processing-e2e-ipp-a-41e815" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-41e815

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-41e815-6bf7cffc54 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

openshift-ingress

multus

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-41e815-6bf7cffc54

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d43409-66cd8996c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d43409-66cd8996c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d43409: serviceaccount "payload-processing-e2e-api-b-d43409" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d43409-7c59ffd85c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d43409-7c59ffd85c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d43409: serviceaccount "payload-processing-e2e-api-b-d43409" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d43409

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d43409-66cd8996c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d43409-66cd8996c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d43409

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d43409-7c59ffd85c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d43409-7c59ffd85c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

openshift-ingress

kubelet

payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.72s (1.72s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.316s (2.316s including waiting). Image size: 166620835 bytes.
(x2)

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-493ec8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-493ec8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f3806a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f3806a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-dda6df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-dda6df-openshift-default-6c99d4898c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-dda6df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-dda6df

openshift-ingress

replicaset-controller

e2e-ipp-b-dda6df-openshift-default-6c99d4898c

SuccessfulCreate

Created pod: e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

openshift-ingress

multus

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cb05ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dda6df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dda6df: serviceaccount "payload-processing-e2e-ipp-b-dda6df" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dda6df-8697d79885

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dda6df-8697d79885

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dda6df-8697d79885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dda6df: serviceaccount "payload-processing-e2e-ipp-b-dda6df" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cb05ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dda6df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dda6df-8697d79885 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-1d29dd-openshift-default-65d4b58fdc

SuccessfulCreate

Created pod: e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f3806a-5d87d748ff-7h4vm

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-api-b-1d29dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1d29dd-openshift-default-65d4b58fdc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-1d29dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1d29dd

openshift-ingress

kubelet

payload-processing-e2e-api-a-f3806a-6c57db5c87-2858m

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1d29dd-7867896fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1d29dd-7867896fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1d29dd: serviceaccount "payload-processing-e2e-api-b-1d29dd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1d29dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1d29dd-c5c47bd4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1d29dd-c5c47bd4f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1d29dd-c5c47bd4f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1d29dd-c5c47bd4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1d29dd: serviceaccount "payload-processing-e2e-api-b-1d29dd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1d29dd-7867896fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1d29dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1d29dd-7867896fff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-41e815-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-41e815-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-f3806a-openshift-default-9d7696669-ltd45

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-493ec8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-493ec8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5ff55ff675-tx58c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-7676c5b54c-ln4sk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cb05ae-5d86698897-qhl2w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cb05ae-67dc695747-9xwp9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-mg7gh

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-l8tgf

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-zqczx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-mzdk5

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-f2kxl

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-stpzb

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cz7bt

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-27490b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-27490b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cb05ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-cb05ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 10 to 7

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-5rk6x

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6gwd8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rhx57

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3437aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3437aa: serviceaccount "payload-processing-e2e-ipp-a-3437aa" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3437aa-5864bf56cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3437aa-5864bf56cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3437aa: serviceaccount "payload-processing-e2e-ipp-a-3437aa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3437aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3437aa-5864bf56cb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-493ec8-5c8db9755f-b488r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3437aa-5864bf56cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

openshift-ingress

multus

payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

openshift-ingress

kubelet

payload-processing-e2e-api-a-493ec8-67976d6b7f-9p85z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d43409-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d43409-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3437aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3437aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-493ec8-openshift-default-76b589f5c7-wbbs4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-85564fc6cf-llqtj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-8697d79885-tl8xj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-cb05ae-openshift-default-7bc99bd8f9-6hcps

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d43409-66cd8996c5-kc6t8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d43409-7c59ffd85c-6f7bh

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-e37c9d-openshift-default-6478988df5

SuccessfulCreate

Created pod: e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

openshift-ingress

deployment-controller

e2e-ipp-b-e37c9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e37c9d-openshift-default-6478988df5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e37c9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e37c9d

openshift-ingress

multus

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e37c9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e37c9d-5956785455 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e37c9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e37c9d-6886954d5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e37c9d: serviceaccount "payload-processing-e2e-ipp-b-e37c9d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e37c9d-6886954d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e37c9d-6886954d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e37c9d: serviceaccount "payload-processing-e2e-ipp-b-e37c9d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

openshift-ingress

multus

payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e37c9d-6886954d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qfzr9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-pbsmq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-q6nlk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-a-a43474-openshift-default-7dccdbb857

SuccessfulCreate

Created pod: e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

openshift-ingress

deployment-controller

e2e-ipp-a-a43474-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a43474-openshift-default-7dccdbb857 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a43474

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a43474

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Unhealthy

Readiness probe failed: Get "http://10.133.0.92:15021/healthz/ready": read tcp 10.133.0.2:42688->10.133.0.92:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

ProbeError

Readiness probe error: Get "http://10.133.0.92:15021/healthz/ready": read tcp 10.133.0.2:42688->10.133.0.92:15021: read: connection reset by peer body:

openshift-ingress

multus

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dda6df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dda6df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a43474

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a43474-545986987f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a43474

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a43474-75b6674f47 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a43474-545986987f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a43474-545986987f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a43474: serviceaccount "payload-processing-e2e-ipp-a-a43474" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a43474-75b6674f47

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a43474-75b6674f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a43474: serviceaccount "payload-processing-e2e-ipp-a-a43474" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a43474-545986987f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a43474-75b6674f47

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-27490b-df699c78c-tl655

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-27490b-5d5c658567-4qsv6

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dda6df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dda6df: serviceaccount "payload-processing-e2e-ipp-b-dda6df" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dda6df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dda6df: serviceaccount "payload-processing-e2e-ipp-b-dda6df" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1d29dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1d29dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d43409-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d43409-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-bmhk6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-q497g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-xqm45

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 10 to 7

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-27490b-openshift-default-6bc89c8cbf-vsc65

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1d29dd-7867896fff-4rcz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-d43409-openshift-default-6ccc9fc775-vkp76

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-1d29dd-c5c47bd4f-ljcb8

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e37c9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e37c9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89

SuccessfulCreate

Created pod: e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

openshift-ingress

deployment-controller

e2e-ipp-a-54f6d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-54f6d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-54f6d8

openshift-ingress

multus

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54f6d8: serviceaccount "payload-processing-e2e-ipp-a-54f6d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-54f6d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54f6d8: serviceaccount "payload-processing-e2e-ipp-a-54f6d8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-54f6d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dda6df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-dda6df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-41e815-585ff4f9c5-mk6db

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-41e815-6bf7cffc54-wjrxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1d29dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-1d29dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-1d29dd-openshift-default-65d4b58fdc-sjcrq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-41e815-openshift-default-649b9cbc9-cpn5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-846492

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-846492

openshift-ingress

replicaset-controller

e2e-ipp-a-846492-openshift-default-65c467f785

SuccessfulCreate

Created pod: e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

openshift-ingress

deployment-controller

e2e-ipp-a-846492-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-846492-openshift-default-65c467f785 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-6886954d5-s9nb9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-5956785455-r4bfk

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-846492

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-846492-5b87b8fc7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-846492-c67886c9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-846492-c67886c9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-846492-c67886c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-846492: serviceaccount "payload-processing-e2e-ipp-a-846492" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-846492-5b87b8fc7f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-846492-5b87b8fc7f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-846492-5b87b8fc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-846492: serviceaccount "payload-processing-e2e-ipp-a-846492" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-846492

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-846492-c67886c9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Unhealthy

Readiness probe failed: Get "http://10.132.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

ProbeError

Readiness probe error: Get "http://10.132.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-545986987f-z9x2j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-75b6674f47-wb9xh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dda6df-86545c69d7-9pjsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dda6df-6b54c6dc5d-5n4dr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a43474-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a43474-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e37c9d: serviceaccount "payload-processing-e2e-ipp-b-e37c9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e37c9d: serviceaccount "payload-processing-e2e-ipp-b-e37c9d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e37c9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e37c9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e37c9d-5d9569d6db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

openshift-ingress

multus

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-4ae722

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-4ae722

openshift-ingress

deployment-controller

e2e-praxis-a-4ae722-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4ae722-openshift-default-9f7cdddd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9

SuccessfulCreate

Created pod: e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-dda6df-openshift-default-6c99d4898c-njh68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4ae722: serviceaccount "payload-processing-e2e-praxis-a-4ae722" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-4ae722

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-5fbdd44c5-c9blj

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4ae722: serviceaccount "payload-processing-e2e-praxis-a-4ae722" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-59d8d66bc9-c6nk9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-4ae722

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-4ae722-68bf5d9f85 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a43474-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a43474-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a43474

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a43474

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a43474-8587dfd448 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a43474-8587dfd448

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a43474-8587dfd448-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a43474: serviceaccount "payload-processing-e2e-ipp-a-a43474" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a43474: serviceaccount "payload-processing-e2e-ipp-a-a43474" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a43474-8587dfd448

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

openshift-ingress

multus

payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54f6d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54f6d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3437aa-fd6f56679-9fl67

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3437aa-5864bf56cb-2cfff

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-54f6d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-54f6d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-54f6d8-694bdf8c64 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54f6d8: serviceaccount "payload-processing-e2e-ipp-a-54f6d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54f6d8: serviceaccount "payload-processing-e2e-ipp-a-54f6d8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2af7b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2af7b0

openshift-ingress

deployment-controller

e2e-ipp-b-2af7b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2af7b0-openshift-default-6956784c49 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-2af7b0-openshift-default-6956784c49

SuccessfulCreate

Created pod: e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

openshift-ingress

multus

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Unhealthy

Readiness probe failed: Get "http://10.132.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

ProbeError

Readiness probe error: Get "http://10.132.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-3437aa-openshift-default-67b59dfbf-cswvf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4ae722-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4ae722-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e37c9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e37c9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2af7b0: serviceaccount "payload-processing-e2e-ipp-b-2af7b0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2af7b0: serviceaccount "payload-processing-e2e-ipp-b-2af7b0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2af7b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2af7b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-c67886c9f-fwcz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-5b87b8fc7f-46q7j

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e37c9d-5d9569d6db-4bkhz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-846492-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-846492-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e37c9d-6dbbd4494c-49jkj

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-b-ea275f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ea275f-openshift-default-68b6755bd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-ea275f-openshift-default-68b6755bd9

SuccessfulCreate

Created pod: e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ea275f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ea275f

openshift-ingress

multus

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54f6d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54f6d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-846492-6b597c56c6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-846492-6b597c56c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-846492: serviceaccount "payload-processing-e2e-ipp-a-846492" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ea275f: serviceaccount "payload-processing-e2e-ipp-b-ea275f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-846492

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-846492-75d94d47c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-846492: serviceaccount "payload-processing-e2e-ipp-a-846492" not found

openshift-ingress

kubelet

e2e-ipp-b-e37c9d-openshift-default-6478988df5-khqms

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ea275f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ea275f-6465d6f9d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ea275f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ea275f: serviceaccount "payload-processing-e2e-ipp-b-ea275f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-846492

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-846492-6b597c56c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

openshift-ingress

replicaset-controller

e2e-praxis-b-191362-openshift-default-5b645bb4fc

SuccessfulCreate

Created pod: e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-846492-6b597c56c6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-b-191362-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-191362-openshift-default-5b645bb4fc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-191362

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-191362

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

openshift-ingress

multus

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

Started

Container started

openshift-ingress

multus

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9

SuccessfulCreate

Created pod: e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-2df502

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-2df502

openshift-ingress

deployment-controller

e2e-praxis-a-2df502-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-2df502-openshift-default-5b67f8cbb9 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-846492-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-846492-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-191362-66ccdf96f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-191362-66ccdf96f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-191362-66ccdf96f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-191362: serviceaccount "payload-processing-e2e-praxis-b-191362" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-191362: serviceaccount "payload-processing-e2e-praxis-b-191362" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-191362

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-191362-66ccdf96f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-191362

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2df502: serviceaccount "payload-processing-e2e-praxis-a-2df502" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-2df502

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-2df502-6597947bdf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2df502-6597947bdf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-2df502-6597947bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2df502: serviceaccount "payload-processing-e2e-praxis-a-2df502" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-2df502

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.104s (2.104s including waiting). Image size: 125353963 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2df502-6597947bdf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Unhealthy

Readiness probe failed: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

ProbeError

Readiness probe error: Get "http://10.132.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-b6cd31-openshift-default-648f4789f

SuccessfulCreate

Created pod: e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b6cd31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b6cd31

openshift-ingress

multus

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-b6cd31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b6cd31-openshift-default-648f4789f from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b6cd31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b6cd31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b6cd31-59d6b865df from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6cd31: serviceaccount "payload-processing-e2e-ipp-b-b6cd31" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6cd31-59d6b865df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6cd31-59d6b865df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b6cd31-59d6b865df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6cd31: serviceaccount "payload-processing-e2e-ipp-b-b6cd31" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-7b4b9c676c-9smm5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-7cd577cf67-xx67d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Unhealthy

Readiness probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

ProbeError

Readiness probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

ProbeError

Readiness probe error: Get "http://10.132.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Unhealthy

Readiness probe failed: Get "http://10.132.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-rgwqf

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6cd31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6cd31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-7fw2m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7fw2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rgwqf

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2af7b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2af7b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-77ff69dc5-q2c7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-6465d6f9d7-hnvgk

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ea275f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ea275f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4ae722-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4ae722-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2af7b0: serviceaccount "payload-processing-e2e-ipp-b-2af7b0" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2af7b0: serviceaccount "payload-processing-e2e-ipp-b-2af7b0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2af7b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2af7b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

ProbeError

Readiness probe error: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Unhealthy

Readiness probe failed: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2af7b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2af7b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ea275f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-ea275f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-68738d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-68738d

openshift-ingress

deployment-controller

e2e-praxis-b-68738d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-68738d-openshift-default-f5d786d69 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-68738d-openshift-default-f5d786d69

SuccessfulCreate

Created pod: e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7
(x5)

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:

openshift-ingress

multus

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-68738d: serviceaccount "payload-processing-e2e-praxis-b-68738d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-68738d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-68738d-f487df4cf from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-68738d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-68738d-5c647d7f6f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-68738d-5c647d7f6f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-68738d-5c647d7f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-68738d: serviceaccount "payload-processing-e2e-praxis-b-68738d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-68738d-5c647d7f6f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2df502-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2df502-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ea275f: serviceaccount "payload-processing-e2e-ipp-b-ea275f" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ea275f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ea275f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ea275f: serviceaccount "payload-processing-e2e-ipp-b-ea275f" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-59d6b865df-bvvgt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-695659fd9f-hw46r

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-191362-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-191362-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2df502-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2df502-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-191362-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-191362-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6cd31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b6cd31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54f6d8-f47b98d7f-rmwd4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54f6d8-694bdf8c64-2lth7

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b6cd31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b6cd31-5d6b5884b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6cd31: serviceaccount "payload-processing-e2e-ipp-b-b6cd31" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b6cd31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b6cd31: serviceaccount "payload-processing-e2e-ipp-b-b6cd31" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-54f6d8-openshift-default-7b6b7d6d89-5kfjp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

ProbeError

Readiness probe error: Get "http://10.133.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Unhealthy

Readiness probe failed: Get "http://10.133.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ea275f-7d6c7ddb56-ccjl5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ea275f-55b77f9d7f-t6wdl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-n4k2n

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb6pk

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-rz5fs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 7 to 5

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8dgpd

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n4k2n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-ggcmd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8pmlx

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-69bj7

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 7 to 6

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-4jnzj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 7 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-846492-6b597c56c6-fsjmm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-846492-75d94d47c9-cmvff

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-68738d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-68738d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-ea275f-openshift-default-68b6755bd9-t9tdg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2df502-684f5d97c5-tqkfc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2df502-6597947bdf-7whbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-846492-openshift-default-65c467f785-q9kpz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-2df502-openshift-default-5b67f8cbb9-qggdx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-68738d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-68738d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-68738d-5c647d7f6f-m288m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-68738d-f487df4cf-s4pvb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b6cd31-57b469ccc5-bc7zg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b6cd31-5d6b5884b-sdn5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-b6cd31-openshift-default-648f4789f-8kn94

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-5d51a5-openshift-default-968d79677

SuccessfulCreate

Created pod: e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

openshift-ingress

deployment-controller

e2e-praxis-a-5d51a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-5d51a5-openshift-default-968d79677 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-5d51a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-5d51a5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-5d51a5: serviceaccount "payload-processing-e2e-praxis-a-5d51a5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-5d51a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-5d51a5: serviceaccount "payload-processing-e2e-praxis-a-5d51a5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-5d51a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-5d51a5-5f49d544cc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-c4ckw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-d8pkj

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-68738d-openshift-default-f5d786d69-vv2f7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

Created

Container created

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4ae722-68bf5d9f85-ljbnp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-4ae722-openshift-default-9f7cdddd9-mv6g8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4ae722-55765b8dcf-z9dr5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-191362-6cb8ff9c59-mn67x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-191362-66ccdf96f7-tcxd7

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-a19e67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-a19e67

openshift-ingress

replicaset-controller

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7

SuccessfulCreate

Created pod: e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

openshift-ingress

deployment-controller

e2e-praxis-b-a19e67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-a19e67-openshift-default-5f48fc9df7 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a19e67-d77bbd859

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a19e67: serviceaccount "payload-processing-e2e-praxis-b-a19e67" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-a19e67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-a19e67-575c997c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-a19e67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-a19e67-d77bbd859 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a19e67-d77bbd859

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-a19e67-d77bbd859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a19e67: serviceaccount "payload-processing-e2e-praxis-b-a19e67" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-a-5d51a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-5d51a5-openshift-default-968d79677 from 1 to 3

openshift-ingress

replicaset-controller

e2e-praxis-a-5d51a5-openshift-default-968d79677

SuccessfulCreate

Created pod: e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

openshift-ingress

replicaset-controller

e2e-praxis-a-5d51a5-openshift-default-968d79677

SuccessfulCreate

Created pod: e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5d51a5-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

Started

Container started

openshift-ingress

multus

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

Started

Container started

openshift-ingress

multus

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

ProbeError

Readiness probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Unhealthy

Readiness probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-191362-openshift-default-5b645bb4fc-2tw7b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 5 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qqfrs

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-qqfrs
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5d51a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Started

Container started

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5d51a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

Started

Container started
(x17)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Unhealthy

Readiness probe failed: Get "https://10.132.0.58:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

ProbeError

Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

Unhealthy

Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a43474-bf9cb9579-xt2x4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a43474-8587dfd448-n6vbk

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5d51a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-5d51a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-a43474-openshift-default-7dccdbb857-g658h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Unhealthy

Readiness probe failed: Get "http://10.132.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

ProbeError

Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Unhealthy

Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

ProbeError

Readiness probe error: Get "http://10.132.0.207:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-5d51a5-55b486f479-fbj89

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-5d51a5-5f49d544cc-2q8fx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.136:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2af7b0-6ff766ff5b-2vpdr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2af7b0-549f76c54c-w575q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-2af7b0-openshift-default-6956784c49-whkll

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-94gf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8xfpw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-5d51a5-openshift-default-968d79677-8gpvk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Started

Container started

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Created

Container created

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Started

Container started

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Started

Container started
(x12)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6nz6h

Unhealthy

Readiness probe failed: Get "https://10.132.0.58:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a19e67-d77bbd859-sgphg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Unhealthy

Readiness probe failed: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

ProbeError

Readiness probe error: Get "http://10.132.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Unhealthy

Readiness probe failed: Get "http://10.132.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

ProbeError

Readiness probe error: Get "http://10.132.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a19e67-575c997c9-8gzb6

Killing

Stopping container payload-pre-processing
(x9)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w2-065de0-openshift-default-64f779b7

SuccessfulCreate

Created pod: e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v
(x11)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-065de0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-065de0

openshift-ingress

deployment-controller

e2e-shared-a-w2-065de0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-065de0-openshift-default-64f779b7 from 0 to 1
(x11)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-065de0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-065de0: serviceaccount "payload-processing-e2e-shared-a-w2-065de0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-065de0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-065de0: serviceaccount "payload-processing-e2e-shared-a-w2-065de0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a19e67-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a19e67-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-e62935

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-e62935

openshift-ingress

replicaset-controller

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687

SuccessfulCreate

Created pod: e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

openshift-ingress

deployment-controller

e2e-shared-a-w3-359f71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-359f71-openshift-default-7cbcf59687 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-a-w0-e62935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-e62935-openshift-default-7684cbb99f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f

SuccessfulCreate

Created pod: e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-359f71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-359f71

openshift-ingress

multus

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

ProbeError

Readiness probe error: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Unhealthy

Readiness probe failed: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-a19e67-openshift-default-5f48fc9df7-bwxln

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

ProbeError

Readiness probe error: Get "http://10.132.0.212:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

ProbeError

Readiness probe error: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Unhealthy

Readiness probe failed: Get "http://10.132.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-sc5jp

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-sc5jp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

ProbeError

Readiness probe error: Get "http://10.132.0.211:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-359f71: serviceaccount "payload-processing-e2e-shared-a-w3-359f71" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-359f71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-359f71: serviceaccount "payload-processing-e2e-shared-a-w3-359f71" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-359f71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-359f71-6976dfcb89 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-smttf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-s9dbf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-e62935: serviceaccount "payload-processing-e2e-shared-a-w0-e62935" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-e62935

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-e62935

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-e62935-5689cd54bf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-e62935: serviceaccount "payload-processing-e2e-shared-a-w0-e62935" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-c59124

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-c59124

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-autores-c59124-openshift-default-9b58f8dc

SuccessfulCreate

Created pod: e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

openshift-ingress

deployment-controller

e2e-autores-c59124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c59124-openshift-default-9b58f8dc from 0 to 1

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

Started

Container started

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

Created

Container created

openshift-ingress

multus

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-autores-c59124

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-c59124-54f6b5ffb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c59124-54f6b5ffb9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c59124-655b84ff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-c59124-655b84ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c59124: serviceaccount "payload-processing-e2e-autores-c59124" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c59124-655b84ff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c59124-54f6b5ffb9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-c59124-54f6b5ffb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c59124: serviceaccount "payload-processing-e2e-autores-c59124" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-c59124

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-c59124-655b84ff5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-9908e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-9908e8
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w4-9908e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-9908e8-openshift-default-df58d4c65 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65

SuccessfulCreate

Created pod: e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

ProbeError

Startup probe error: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

ProbeError

Startup probe error: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

Unhealthy

Startup probe failed: Get "http://10.132.0.219:15021/healthz/ready": dial tcp 10.132.0.219:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

Unhealthy

Startup probe failed: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

Created

Container created

openshift-ingress

multus

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7ef1b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7ef1b6

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f

SuccessfulCreate

Created pod: e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

openshift-ingress

deployment-controller

e2e-shared-b-w2-7ef1b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-9908e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-9908e8-955f5c679 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-9908e8-955f5c679

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-9908e8-955f5c679

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-9908e8-955f5c679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-9908e8: serviceaccount "payload-processing-e2e-shared-a-w4-9908e8" not found
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-9908e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-8fzrc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-8fzrc

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-9908e8: serviceaccount "payload-processing-e2e-shared-a-w4-9908e8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulCreate

Created pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7ef1b6: serviceaccount "payload-processing-e2e-shared-b-w2-7ef1b6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7ef1b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7ef1b6: serviceaccount "payload-processing-e2e-shared-b-w2-7ef1b6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7ef1b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-2858fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-2858fb

openshift-ingress

replicaset-controller

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f

SuccessfulCreate

Created pod: e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

openshift-ingress

deployment-controller

e2e-shared-b-w3-2858fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-2858fb-openshift-default-f6599f46f from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97

SuccessfulCreate

Created pod: e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-a07a90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-a07a90

openshift-ingress

deployment-controller

e2e-shared-b-w0-a07a90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-2858fb: serviceaccount "payload-processing-e2e-shared-b-w3-2858fb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-2858fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-2858fb-6749b44d75 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-2858fb: serviceaccount "payload-processing-e2e-shared-b-w3-2858fb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-2858fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-a07a90: serviceaccount "payload-processing-e2e-shared-b-w0-a07a90" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-a07a90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-a07a90: serviceaccount "payload-processing-e2e-shared-b-w0-a07a90" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-a07a90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9908e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9908e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

ProbeError

Startup probe error: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Unhealthy

Startup probe failed: Get "http://10.132.0.214:15021/healthz/ready": dial tcp 10.132.0.214:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-l2q2c

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-359f71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e62935-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e62935-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-359f71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-065de0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-065de0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c59124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c59124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lnm9s

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-lnm9s

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-7nrll
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e62935-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5

SuccessfulCreate

Created pod: e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-20109d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-20109d

openshift-ingress

deployment-controller

e2e-shared-b-w4-20109d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-20109d-openshift-default-fdcf648d5 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e62935-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

Started

Container started

openshift-ingress

multus

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-359f71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-359f71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-7ef1b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-7ef1b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c59124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c59124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-20109d-6955788f79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-20109d-6955788f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-20109d: serviceaccount "payload-processing-e2e-shared-b-w4-20109d" not found
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

Unhealthy

Startup probe failed: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

ProbeError

Startup probe error: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-20109d-6955788f79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-20109d: serviceaccount "payload-processing-e2e-shared-b-w4-20109d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-20109d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-20109d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-20109d-6955788f79 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

Started

Container started

openshift-ingress

replicaset-controller

e2e-autores-c59124-openshift-default-9b58f8dc

SuccessfulCreate

Created pod: e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

openshift-ingress

deployment-controller

e2e-autores-c59124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c59124-openshift-default-9b58f8dc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c59124-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Created

Container created

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2858fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2858fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-7ef1b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-7ef1b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9908e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-9908e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2858fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2858fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a07a90-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a07a90-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687

SuccessfulCreate

Created pod: e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

Started

Container started

openshift-ingress

multus

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-359f71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-359f71-openshift-default-7cbcf59687 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-359f71-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c59124-655b84ff5-bgnzh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-c59124-54f6b5ffb9-6gxh4

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-20109d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-20109d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-cq9rc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-b43332-openshift-default-5f447b8877

SuccessfulCreate

Created pod: e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-c59124-openshift-default-9b58f8dc-sbqdl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-b43332-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b43332-openshift-default-5f447b8877 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-b43332

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b43332

openshift-ingress

multus

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b43332

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b43332-7d5fcfc999 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b43332

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b43332-5787b6764c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b43332: serviceaccount "payload-processing-e2e-explicit-b43332" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b43332-5787b6764c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b43332-5787b6764c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b43332: serviceaccount "payload-processing-e2e-explicit-b43332" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b43332-5787b6764c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-20109d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-20109d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97

SuccessfulCreate

Created pod: e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a07a90-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w0-a07a90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97 from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

ProbeError

Readiness probe error: Get "http://10.132.0.232:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Unhealthy

Readiness probe failed: Get "http://10.132.0.232:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-b43332-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-b43332-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-b43332-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-b43332-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-explicit-b43332-5787b6764c-rd7tt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b43332-7d5fcfc999-fc6lq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-b43332-openshift-default-5f447b8877-5k66w

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7609-78cfcc

Started

Container started

opendatahub

kubelet

test-curl-7609-78cfcc

Created

Container created

opendatahub

multus

test-curl-7609-78cfcc

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-78cfcc

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-099583-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-099583-openshift-default-59874d54f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-099583-openshift-default-59874d54f

SuccessfulCreate

Created pod: e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8pgtj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zjzd7

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-099583

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-099583

openshift-ingress

multus

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 10 to 8

opendatahub

kubelet

test-curl-7609-78cfcc

Killing

Stopping container test-curl-7609-78cfcc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-099583

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-099583-568499c68c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-099583-b94d76f8c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-099583-b94d76f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-099583: serviceaccount "payload-processing-e2e-shared-a-w1-099583" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-099583

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-099583-b94d76f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-099583: serviceaccount "payload-processing-e2e-shared-a-w1-099583" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-099583-b94d76f8c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

Started

Container started

opendatahub

kubelet

test-curl-7612-18acc3

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7612-18acc3

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7612-18acc3

Created

Container created

opendatahub

kubelet

test-curl-7612-18acc3

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.148s (1.148s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7612-18acc3

Started

Container started

opendatahub

kubelet

test-curl-7612-c144dd

Started

Container started

opendatahub

multus

test-curl-7612-c144dd

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7612-c144dd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7612-c144dd

Created

Container created

opendatahub

kubelet

test-curl-7612-18acc3

Killing

Stopping container test-curl-7612-18acc3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

opendatahub

kubelet

test-curl-7612-347ab8

Started

Container started

opendatahub

kubelet

test-curl-7612-347ab8

Created

Container created

opendatahub

kubelet

test-curl-7612-347ab8

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qshkg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vgcfx

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lpbl8

opendatahub

multus

test-curl-7612-347ab8

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dwgpx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-4pcph

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 10 to 6

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-bb72p

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7612-c144dd

Killing

Stopping container test-curl-7612-c144dd

opendatahub

kubelet

test-curl-7612-cca854

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7612-cca854

Started

Container started

opendatahub

kubelet

test-curl-7612-cca854

Created

Container created

opendatahub

multus

test-curl-7612-cca854

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7612-347ab8

Killing

Stopping container test-curl-7612-347ab8

openshift-ingress

replicaset-controller

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7

SuccessfulCreate

Created pod: e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d9e067

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d9e067

opendatahub

kubelet

test-curl-7612-cca854

Killing

Stopping container test-curl-7612-cca854

openshift-ingress

deployment-controller

e2e-extmod-a-d9e067-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d9e067-openshift-default-7487dcb7c7 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d9e067

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d9e067-65c5df4dd9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d9e067: serviceaccount "payload-processing-e2e-extmod-a-d9e067" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d9e067: serviceaccount "payload-processing-e2e-extmod-a-d9e067" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d9e067

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-qqtxz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-k5c9l

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-6qch2

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-r7qxd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-8jrtz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-kjlpp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-kjlpp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-km9q2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7jxwd

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-ldgbh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-94v5b

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-jqlsh
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-djbxm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-6hrgm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-7615-5304f0

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7615-5304f0

Created

Container created

opendatahub

kubelet

test-curl-7615-5304f0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7615-5304f0

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d87781

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d87781

opendatahub

kubelet

test-curl-7615-5304f0

Killing

Stopping container test-curl-7615-5304f0

openshift-ingress

deployment-controller

e2e-extmod-a-d87781-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d87781-openshift-default-57f799fb65 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-d87781-openshift-default-57f799fb65

SuccessfulCreate

Created pod: e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

openshift-ingress

multus

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-5c109b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859

SuccessfulCreate

Created pod: e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 6 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-5c109b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-5c109b

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-lh6p6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d87781-5574866475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d87781-5574866475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d87781-5574866475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d87781: serviceaccount "payload-processing-e2e-extmod-a-d87781" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d87781

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d87781-5574866475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d87781-68568f5fc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d87781

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d87781-68568f5fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d87781-68568f5fc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d87781-68568f5fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d87781: serviceaccount "payload-processing-e2e-extmod-a-d87781" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-5c109b: serviceaccount "payload-processing-e2e-shared-b-w1-5c109b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-5c109b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-5c109b: serviceaccount "payload-processing-e2e-shared-b-w1-5c109b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-5c109b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

Started

Container started

opendatahub

kubelet

test-curl-7618-aa49f0

Created

Container created

opendatahub

multus

test-curl-7618-aa49f0

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7618-aa49f0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7618-aa49f0

Started

Container started

opendatahub

kubelet

test-curl-7618-aa49f0

Killing

Stopping container test-curl-7618-aa49f0

openshift-ingress

replicaset-controller

e2e-shared-a-w1-099583-openshift-default-59874d54f

SuccessfulCreate

Created pod: e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w1-099583-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-099583-openshift-default-59874d54f from 1 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w1-099583-openshift-default-59874d54f

SuccessfulCreate

Created pod: e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

Created

Container created

openshift-ingress

multus

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d9e067-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d9e067-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

ProbeError

Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Unhealthy

Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-fdacdb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-fdacdb

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulCreate

Created pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

openshift-ingress

multus

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-5lnf2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-l2q2c

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-qrj5l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l2q2c

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-wn5n8

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5lnf2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zmcw9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-8x5pg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-fdacdb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fdacdb: serviceaccount "payload-processing-e2e-extmod-b-fdacdb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fdacdb: serviceaccount "payload-processing-e2e-extmod-b-fdacdb" not found

openshift-ingress

deployment-controller

e2e-noten-d833b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d833b8-openshift-default-74644d6bd9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-fdacdb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-d833b8-openshift-default-74644d6bd9

SuccessfulCreate

Created pod: e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

openshift-ingress

gateway_labeler_controller

e2e-noten-d833b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d833b8

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

multus

e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

Started

Container started

openshift-ingress

kubelet

e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

Created

Container created

openshift-ingress

kubelet

e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-955dc3-openshift-default-76559d4f5c

SuccessfulCreate

Created pod: e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

openshift-ingress

deployment-controller

e2e-extmod-a-955dc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-955dc3-openshift-default-76559d4f5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-955dc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-955dc3

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-955dc3-567769895c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-955dc3-567769895c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-955dc3-567769895c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-955dc3: serviceaccount "payload-processing-e2e-extmod-a-955dc3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-955dc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-955dc3-567769895c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-955dc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-955dc3: serviceaccount "payload-processing-e2e-extmod-a-955dc3" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d9e067-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d9e067-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d833b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d833b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Unhealthy

Readiness probe failed: Get "http://10.134.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

ProbeError

Readiness probe error: Get "http://10.134.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Started

Container started

openshift-ingress

kubelet

e2e-noten-d833b8-openshift-default-74644d6bd9-vt69j

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-b-d4d8c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d4d8c2-openshift-default-c64d656b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5

SuccessfulCreate

Created pod: e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d4d8c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d4d8c2

openshift-ingress

multus

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-c738e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-c738e0

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d4d8c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d4d8c2-5c9965d747 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d4d8c2: serviceaccount "payload-processing-e2e-extmod-b-d4d8c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

openshift-ingress

replicaset-controller

e2e-extmod-a-c738e0-openshift-default-8ff7b4997

SuccessfulCreate

Created pod: e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

openshift-ingress

deployment-controller

e2e-extmod-a-c738e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-c738e0-openshift-default-8ff7b4997 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d4d8c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d4d8c2: serviceaccount "payload-processing-e2e-extmod-b-d4d8c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c738e0: serviceaccount "payload-processing-e2e-extmod-a-c738e0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-c738e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-c738e0-6856cdb979 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c738e0-6856cdb979

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-c738e0-6856cdb979

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-c738e0-6856cdb979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-c738e0: serviceaccount "payload-processing-e2e-extmod-a-c738e0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-c738e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

openshift-ingress

multus

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d87781-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d87781-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-5c109b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-5c109b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Unhealthy

Startup probe failed: Get "http://10.132.0.245:15021/healthz/ready": dial tcp 10.132.0.245:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

ProbeError

Startup probe error: Get "http://10.132.0.245:15021/healthz/ready": dial tcp 10.132.0.245:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-850433

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-850433

openshift-ingress

replicaset-controller

e2e-extmod-a-850433-openshift-default-7584745dd9

SuccessfulCreate

Created pod: e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

openshift-ingress

deployment-controller

e2e-extmod-a-850433-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-850433-openshift-default-7584745dd9 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-850433-7c84b7db7c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-850433-7c84b7db7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-850433: serviceaccount "payload-processing-e2e-extmod-a-850433" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-850433

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-850433-7c84b7db7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-850433-7c84b7db7c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-850433-66886bbf87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-850433-66886bbf87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-850433: serviceaccount "payload-processing-e2e-extmod-a-850433" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-850433-66886bbf87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-850433

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-850433-66886bbf87 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

ProbeError

Startup probe error: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Unhealthy

Startup probe failed: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-955dc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-955dc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-909268

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-909268

openshift-ingress

deployment-controller

e2e-extmod-b-909268-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-909268-openshift-default-846d5db8fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-909268-openshift-default-846d5db8fc

SuccessfulCreate

Created pod: e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

openshift-ingress

multus

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-955dc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-955dc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-909268

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-909268-6f94f47577 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-909268-6f94f47577

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-909268-6f94f47577

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-909268-6f94f47577-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-909268: serviceaccount "payload-processing-e2e-extmod-b-909268" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-909268

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-909268: serviceaccount "payload-processing-e2e-extmod-b-909268" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-850433-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-850433-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

ProbeError

Readiness probe error: Get "http://10.133.0.161:15021/healthz/ready": read tcp 10.133.0.2:56884->10.133.0.161:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Unhealthy

Readiness probe failed: Get "http://10.133.0.161:15021/healthz/ready": read tcp 10.133.0.2:56884->10.133.0.161:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-909268-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-909268-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

ProbeError

Startup probe error: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Unhealthy

Startup probe failed: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d4d8c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d4d8c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0db47e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0db47e

openshift-ingress

deployment-controller

e2e-extmod-b-0db47e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0db47e-openshift-default-ffcc9464f from 0 to 1

openshift-ingress

multus

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-0db47e-openshift-default-ffcc9464f

SuccessfulCreate

Created pod: e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c738e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c738e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0db47e-979769587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0db47e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0db47e-979769587 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0db47e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0db47e-9695866b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0db47e-9695866b9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0db47e-9695866b9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0db47e-9695866b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0db47e: serviceaccount "payload-processing-e2e-extmod-b-0db47e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0db47e-979769587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0db47e-979769587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0db47e: serviceaccount "payload-processing-e2e-extmod-b-0db47e" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d4d8c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d4d8c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c738e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-c738e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-ac338d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-ac338d

openshift-ingress

deployment-controller

e2e-extmod-b-ac338d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-ac338d-openshift-default-d94664777 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulCreate

Created pod: e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

openshift-ingress

multus

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ac338d-767b8df89c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ac338d: serviceaccount "payload-processing-e2e-extmod-b-ac338d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-ac338d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-ac338d-767b8df89c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-ac338d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ac338d-767b8df89c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-ac338d-767b8df89c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ac338d: serviceaccount "payload-processing-e2e-extmod-b-ac338d" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

ProbeError

Readiness probe error: Get "http://10.133.0.169:15021/healthz/ready": read tcp 10.133.0.2:39018->10.133.0.169:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Unhealthy

Readiness probe failed: Get "http://10.133.0.169:15021/healthz/ready": read tcp 10.133.0.2:39018->10.133.0.169:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-850433-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-850433-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Unhealthy

Startup probe failed: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

ProbeError

Startup probe error: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-909268-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-909268-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

ProbeError

Readiness probe error: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Unhealthy

Readiness probe failed: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-qjtjz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-lgsch

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulCreate

Created pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Started

Container started

openshift-ingress

multus

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-cd6bz

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 4 to 3
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0db47e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0db47e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

ProbeError

Readiness probe error: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Unhealthy

Readiness probe failed: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x4)

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 4 to 3
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-4fzk9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0db47e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0db47e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-099583-openshift-default-59874d54f

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-099583-openshift-default-59874d54f-26rwn

openshift-ingress

deployment-controller

e2e-shared-a-w1-099583-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-099583-openshift-default-59874d54f from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulCreate

Created pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 2 to 3

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Unhealthy

Startup probe failed: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

ProbeError

Startup probe error: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w3-359f71-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-359f71-openshift-default-7cbcf59687 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-359f71-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-wtzmw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-extmod-b-ac338d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-ac338d-openshift-default-d94664777 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulCreate

Created pod: e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Started

Container started

openshift-ingress

multus

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

ProbeError

Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Unhealthy

Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulCreate

Created pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 3 to 4

openshift-ingress

multus

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d4d8c2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-d4d8c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d4d8c2-openshift-default-c64d656b5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5

SuccessfulCreate

Created pod: e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

openshift-ingress

multus

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

AddedInterface

Add eth0 [10.132.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 2 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-zhtvp

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-zhtvp

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zhtvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zhtvp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zhtvp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

Created

Container created

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-extmod-a-850433-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-850433-openshift-default-7584745dd9 from 1 to 2
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-850433-openshift-default-7584745dd9

SuccessfulCreate

Created pod: e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-850433-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulCreate

Created pod: e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

Unhealthy

Startup probe failed: Get "http://10.132.1.3:15021/healthz/ready": dial tcp 10.132.1.3:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

ProbeError

Startup probe error: Get "http://10.132.1.3:15021/healthz/ready": dial tcp 10.132.1.3:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulCreate

Created pod: e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

openshift-ingress

deployment-controller

e2e-extmod-b-ac338d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-ac338d-openshift-default-d94664777 from 2 to 4

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Started

Container started

openshift-ingress

multus

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Created

Container created

openshift-ingress

multus

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

AddedInterface

Add eth0 [10.132.1.6/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

ProbeError

Startup probe error: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

Unhealthy

Startup probe failed: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zhtvp

Unhealthy

Startup probe failed: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zhtvp

ProbeError

Startup probe error: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w0-e62935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-e62935-openshift-default-7684cbb99f from 1 to 2
(x5)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

ProbeError

Startup probe error: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e62935-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f

SuccessfulCreate

Created pod: e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd
(x5)

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Unhealthy

Startup probe failed: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Unhealthy

Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

ProbeError

Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Unhealthy

Startup probe failed: Get "http://10.132.1.6:15021/healthz/ready": dial tcp 10.132.1.6:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

ProbeError

Startup probe error: Get "http://10.132.1.6:15021/healthz/ready": dial tcp 10.132.1.6:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

ProbeError

Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Unhealthy

Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-78576756d4 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-78576756d4

FailedCreate

Error creating: pods "payload-processing-external-model-78576756d4-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-78576756d4

SuccessfulCreate

Created pod: payload-processing-external-model-78576756d4-8czpf

models-as-a-service

kubelet

payload-processing-external-model-78576756d4-8czpf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-78576756d4-8czpf

Started

Container started

models-as-a-service

multus

payload-processing-external-model-78576756d4-8czpf

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-78576756d4-8czpf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-76d5d774bc from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-76d5d774bc

SuccessfulCreate

Created pod: payload-processing-external-model-76d5d774bc-r25fn

models-as-a-service

kubelet

payload-processing-external-model-76d5d774bc-r25fn

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-76d5d774bc-r25fn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-76d5d774bc-r25fn

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-76d5d774bc-r25fn

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-cdvd9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-6q926

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-w5m48
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 3 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-6q926

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-6q926

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-w5m48

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-cdvd9

AddedInterface

Add eth0 [10.132.1.7/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-6q926

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-6q926

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-78576756d4 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-78576756d4-8czpf

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-78576756d4

SuccessfulDelete

Deleted pod: payload-processing-external-model-78576756d4-8czpf
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-6q926

Unhealthy

Startup probe failed: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

Unhealthy

Startup probe failed: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

ProbeError

Startup probe error: Get "http://10.132.1.7:15021/healthz/ready": dial tcp 10.132.1.7:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-6q926

ProbeError

Startup probe error: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

Unhealthy

Startup probe failed: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

ProbeError

Startup probe error: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f4bbcf7

SuccessfulCreate

Created pod: payload-processing-external-model-5d5f4bbcf7-mpcdh

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-mpcdh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5d5f4bbcf7-mpcdh

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-mpcdh

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-mpcdh

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f4bbcf7

SuccessfulDelete

Deleted pod: payload-processing-external-model-5d5f4bbcf7-mpcdh

models-as-a-service

replicaset-controller

payload-processing-external-model-5db79bd7f6

SuccessfulCreate

Created pod: payload-processing-external-model-5db79bd7f6-kntx2

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-mpcdh

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-kntx2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5db79bd7f6-kntx2

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-kntx2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-kntx2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-kntx2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-r2qqg

models-as-a-service

replicaset-controller

payload-processing-external-model-5db79bd7f6

SuccessfulDelete

Deleted pod: payload-processing-external-model-5db79bd7f6-kntx2

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f4bbcf7

SuccessfulCreate

Created pod: payload-processing-external-model-5d5f4bbcf7-2ngxx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-zqd94

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-hn6jd

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-44ncj

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-2ngxx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-2ngxx

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-2ngxx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5d5f4bbcf7-2ngxx

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r2qqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r2qqg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-r2qqg

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-hn6jd

AddedInterface

Add eth0 [10.132.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-44ncj

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-zqd94

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r2qqg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-5db79bd7f6

SuccessfulCreate

Created pod: payload-processing-external-model-5db79bd7f6-9b7f6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

Started

Container started
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5d5f4bbcf7 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f4bbcf7

SuccessfulDelete

Deleted pod: payload-processing-external-model-5d5f4bbcf7-2ngxx
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5db79bd7f6 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-9b7f6

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-9b7f6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5db79bd7f6-9b7f6

AddedInterface

Add eth0 [10.134.0.229/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-9b7f6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-2ngxx

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f4bbcf7

SuccessfulCreate

Created pod: payload-processing-external-model-5d5f4bbcf7-jtrbd

models-as-a-service

kubelet

payload-processing-external-model-5db79bd7f6-9b7f6

Killing

Stopping container payload-processing
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5db79bd7f6 from 1 to 0
(x3)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5d5f4bbcf7 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5db79bd7f6

SuccessfulDelete

Deleted pod: payload-processing-external-model-5db79bd7f6-9b7f6
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

ProbeError

Startup probe error: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused body:

models-as-a-service

multus

payload-processing-external-model-5d5f4bbcf7-jtrbd

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

ProbeError

Startup probe error: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

Unhealthy

Startup probe failed: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-jtrbd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-jtrbd

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

Unhealthy

Startup probe failed: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-jtrbd

Started

Container started
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

ProbeError

Startup probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

Unhealthy

Startup probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r2qqg

ProbeError

Startup probe error: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r2qqg

Unhealthy

Startup probe failed: Get "http://10.133.0.209:15021/healthz/ready": dial tcp 10.133.0.209:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

Unhealthy

Startup probe failed: Get "http://10.134.0.227:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

ProbeError

Startup probe error: Get "http://10.134.0.227:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-76d5d774bc-r25fn

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-76d5d774bc

SuccessfulDelete

Deleted pod: payload-processing-external-model-76d5d774bc-r25fn

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-76d5d774bc from 1 to 0

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-bc94678d4 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-bc94678d4

SuccessfulCreate

Created pod: payload-processing-external-model-bc94678d4-jrb5l

models-as-a-service

kubelet

payload-processing-external-model-bc94678d4-jrb5l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-bc94678d4-jrb5l

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-bc94678d4-jrb5l

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-bc94678d4-jrb5l

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-bc94678d4 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-bc94678d4

SuccessfulDelete

Deleted pod: payload-processing-external-model-bc94678d4-jrb5l

models-as-a-service

kubelet

payload-processing-external-model-bc94678d4-jrb5l

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-jtrbd

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5d5f4bbcf7-jtrbd

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.230:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

e2e-inf-a-84f605-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-84f605-openshift-default-74967b9b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-84f605

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-84f605

openshift-ingress

replicaset-controller

e2e-inf-a-84f605-openshift-default-74967b9b5

SuccessfulCreate

Created pod: e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

openshift-ingress

multus

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-84f605-54f997d46c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-84f605-54f997d46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-84f605: serviceaccount "payload-processing-e2e-inf-a-84f605" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-84f605

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-84f605-54f997d46c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-84f605-54f997d46c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-84f605-6d99b7fb8c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-84f605-6d99b7fb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-84f605: serviceaccount "payload-processing-e2e-inf-a-84f605" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-84f605-6d99b7fb8c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-84f605

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-84f605-6d99b7fb8c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

AddedInterface

Add eth0 [10.134.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-kzsj7

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Created

Container created
(x3)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 3 to 2
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-rp49v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

ProbeError

Readiness probe error: Get "http://10.134.0.243:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Unhealthy

Readiness probe failed: Get "http://10.134.0.243:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

ProbeError

Startup probe error: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Unhealthy

Startup probe failed: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-84f605-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-84f605-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-726205

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-726205

openshift-ingress

deployment-controller

e2e-inf-b-726205-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-726205-openshift-default-b6c76c5b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-726205-openshift-default-b6c76c5b5

SuccessfulCreate

Created pod: e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

openshift-ingress

multus

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-726205-845cc5ff87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-726205-694cb8fcff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-726205-694cb8fcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-726205: serviceaccount "payload-processing-e2e-inf-b-726205" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-726205-694cb8fcff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-726205-845cc5ff87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-726205-845cc5ff87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-726205: serviceaccount "payload-processing-e2e-inf-b-726205" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-726205

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-726205-845cc5ff87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-726205

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-726205-694cb8fcff from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-84f605-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-84f605-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-883a9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-883a9e

openshift-ingress

deployment-controller

e2e-inf-a-883a9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-883a9e-openshift-default-567bfd88dc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-883a9e-openshift-default-567bfd88dc

SuccessfulCreate

Created pod: e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

openshift-ingress

multus

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

AddedInterface

Add eth0 [10.134.0.250/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-883a9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-883a9e: serviceaccount "payload-processing-e2e-inf-a-883a9e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-883a9e-545cdf9bd9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-883a9e-545cdf9bd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-883a9e: serviceaccount "payload-processing-e2e-inf-a-883a9e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-883a9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-883a9e-545cdf9bd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

openshift-ingress

multus

payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-883a9e-545cdf9bd9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

openshift-ingress

kubelet

payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-a-49d7e5-openshift-default-6567775c79

SuccessfulCreate

Created pod: e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

openshift-ingress

deployment-controller

e2e-inf-a-49d7e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-49d7e5-openshift-default-6567775c79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-49d7e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-49d7e5

openshift-ingress

multus

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-49d7e5-99dbd976f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-49d7e5-99dbd976f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-49d7e5: serviceaccount "payload-processing-e2e-inf-a-49d7e5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-49d7e5: serviceaccount "payload-processing-e2e-inf-a-49d7e5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-49d7e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-49d7e5-99dbd976f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-49d7e5-99dbd976f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-49d7e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Unhealthy

Readiness probe failed: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

ProbeError

Readiness probe error: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Unhealthy

Startup probe failed: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

ProbeError

Startup probe error: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-726205-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-726205-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

ProbeError

Startup probe error: Get "http://10.134.0.250:15021/healthz/ready": dial tcp 10.134.0.250:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Unhealthy

Startup probe failed: Get "http://10.134.0.250:15021/healthz/ready": dial tcp 10.134.0.250:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-883a9e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-883a9e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-726205-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-726205-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-883a9e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-883a9e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-056a96-openshift-default-777fc45c8c

SuccessfulCreate

Created pod: e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

openshift-ingress

deployment-controller

e2e-inf-b-056a96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-056a96-openshift-default-777fc45c8c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-056a96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-056a96

openshift-ingress

multus

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-056a96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-056a96-6d9bf47485 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-056a96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-056a96: serviceaccount "payload-processing-e2e-inf-b-056a96" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-056a96-6d9bf47485

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-056a96-6d9bf47485

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-056a96-6d9bf47485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-056a96: serviceaccount "payload-processing-e2e-inf-b-056a96" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-gb4zj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-726205-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-726205-openshift-default-b6c76c5b5 from 1 to 2

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-726205-openshift-default-b6c76c5b5

SuccessfulCreate

Created pod: e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-726205-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x8)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-7f20f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-7f20f7-openshift-default-87bd658df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-7f20f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-7f20f7

openshift-ingress

replicaset-controller

e2e-inf-b-7f20f7-openshift-default-87bd658df

SuccessfulCreate

Created pod: e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulDelete

Deleted pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

ProbeError

Startup probe error: Get "http://10.133.0.224:15021/healthz/ready": dial tcp 10.133.0.224:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

Unhealthy

Startup probe failed: Get "http://10.133.0.224:15021/healthz/ready": dial tcp 10.133.0.224:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-w8htr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7f20f7-d7cc67c75

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-7f20f7-d7cc67c75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7f20f7: serviceaccount "payload-processing-e2e-inf-b-7f20f7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7f20f7-d7cc67c75

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7f20f7: serviceaccount "payload-processing-e2e-inf-b-7f20f7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-7f20f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-rn9x8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-7f20f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-7f20f7-d7cc67c75 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

AddedInterface

Add eth0 [10.134.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-49d7e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-49d7e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

AddedInterface

Add eth0 [10.134.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-559tg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-inf-a-29d09b-openshift-default-56b588f5c5

SuccessfulCreate

Created pod: e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

openshift-ingress

gateway_labeler_controller

e2e-inf-a-8ed55a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-8ed55a

openshift-ingress

deployment-controller

e2e-inf-a-8ed55a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-8ed55a-openshift-default-55cf654d4c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-29d09b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-29d09b

openshift-ingress

replicaset-controller

e2e-inf-a-8ed55a-openshift-default-55cf654d4c

SuccessfulCreate

Created pod: e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

openshift-ingress

deployment-controller

e2e-inf-a-29d09b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-29d09b-openshift-default-56b588f5c5 from 0 to 1

openshift-ingress

multus

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

AddedInterface

Add eth0 [10.134.1.10/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-099583-openshift-default-59874d54f

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

openshift-ingress

deployment-controller

e2e-shared-a-w1-099583-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-099583-openshift-default-59874d54f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-29d09b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-29d09b-7ccd86d88f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-29d09b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-29d09b: serviceaccount "payload-processing-e2e-inf-a-29d09b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-29d09b-7ccd86d88f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-29d09b-7ccd86d88f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-29d09b: serviceaccount "payload-processing-e2e-inf-a-29d09b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-29d09b-7ccd86d88f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

AddedInterface

Add eth0 [10.134.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

AddedInterface

Add eth0 [10.134.1.13/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8ed55a-646db6d969

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-8ed55a-646db6d969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8ed55a: serviceaccount "payload-processing-e2e-inf-a-8ed55a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-8ed55a-646db6d969

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-8ed55a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-6lvw9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-8ed55a: serviceaccount "payload-processing-e2e-inf-a-8ed55a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-8ed55a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-8ed55a-646db6d969 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

AddedInterface

Add eth0 [10.134.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-r2qqg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-6q926

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-6q926

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-r2qqg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-49d7e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-49d7e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-29d09b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8ed55a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8ed55a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-29d09b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

ProbeError

Readiness probe error: Get "http://10.133.0.227:15021/healthz/ready": read tcp 10.133.0.2:49498->10.133.0.227:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Unhealthy

Readiness probe failed: Get "http://10.133.0.227:15021/healthz/ready": read tcp 10.133.0.2:49498->10.133.0.227:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Unhealthy

Startup probe failed: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

ProbeError

Startup probe error: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-056a96-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-056a96-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

Unhealthy

Startup probe failed: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

ProbeError

Startup probe error: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-056a96-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-056a96-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7f20f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-7f20f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Unhealthy

Startup probe failed: Get "http://10.134.1.10:15021/healthz/ready": dial tcp 10.134.1.10:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

ProbeError

Startup probe error: Get "http://10.134.1.10:15021/healthz/ready": dial tcp 10.134.1.10:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-b-537652-openshift-default-746478548f

SuccessfulCreate

Created pod: e2e-inf-b-537652-openshift-default-746478548f-zvwjz

openshift-ingress

deployment-controller

e2e-inf-b-537652-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-537652-openshift-default-746478548f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-537652

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-537652

openshift-ingress

multus

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-056a96-openshift-default-777fc45c8c

SuccessfulCreate

Created pod: e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

openshift-ingress

multus

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

AddedInterface

Add eth0 [10.134.1.17/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-inf-b-056a96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-056a96-openshift-default-777fc45c8c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-056a96-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-70c7d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-70c7d6-openshift-default-7f7f5bb95 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95

SuccessfulCreate

Created pod: e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

openshift-ingress

gateway_labeler_controller

e2e-inf-b-70c7d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-70c7d6

openshift-ingress

multus

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

AddedInterface

Add eth0 [10.133.0.242/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-537652

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-537652-5dd9974447 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-537652-5dd9974447

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-537652-5dd9974447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-537652: serviceaccount "payload-processing-e2e-inf-b-537652" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-537652-5dd9974447

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-537652-7d5c567859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-537652-7d5c567859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-537652: serviceaccount "payload-processing-e2e-inf-b-537652" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-537652-7d5c567859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-537652

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-537652-7d5c567859 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

AddedInterface

Add eth0 [10.133.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

ProbeError

Startup probe error: Get "http://10.134.1.17:15021/healthz/ready": dial tcp 10.134.1.17:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

Unhealthy

Startup probe failed: Get "http://10.134.1.17:15021/healthz/ready": dial tcp 10.134.1.17:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-70c7d6-67775dcc4f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-70c7d6: serviceaccount "payload-processing-e2e-inf-b-70c7d6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-70c7d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-70c7d6-67775dcc4f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-70c7d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-70c7d6-67775dcc4f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-70c7d6-67775dcc4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-70c7d6: serviceaccount "payload-processing-e2e-inf-b-70c7d6" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

AddedInterface

Add eth0 [10.133.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

Unhealthy

Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

ProbeError

Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-29d09b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-29d09b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8ed55a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-8ed55a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-84f605-6d99b7fb8c-lqs2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-zhtvp
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 8 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zhtvp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 7; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-84f605-54f997d46c-t9jt9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-cp69r

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-a-84f605-openshift-default-74967b9b5-tccjn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-70c7d6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-70c7d6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-4swl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-726205-openshift-default-b6c76c5b5-hrxxq

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

ProbeError

Startup probe error: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Unhealthy

Startup probe failed: Get "http://10.133.0.242:15021/healthz/ready": dial tcp 10.133.0.242:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-726205-694cb8fcff-tdh6s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-726205-845cc5ff87-zgcrf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Unhealthy

Readiness probe failed: Get "http://10.133.0.241:15021/healthz/ready": read tcp 10.133.0.2:35322->10.133.0.241:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

ProbeError

Readiness probe error: Get "http://10.133.0.241:15021/healthz/ready": read tcp 10.133.0.2:35322->10.133.0.241:15021: read: connection reset by peer body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-70c7d6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-70c7d6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-537652-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-537652-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-537652-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-537652-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-vrgzs
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 7 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-mnd7q

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-666b4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-mnd7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-666b4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-666b4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-mnd7q

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-mnd7q

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-666b4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-mnd7q

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vrgzs

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vrgzs

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vrgzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-vrgzs

AddedInterface

Add eth0 [10.132.1.29/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-666b4

AddedInterface

Add eth0 [10.134.1.28/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-666b4

ProbeError

Startup probe error: Get "http://10.134.1.28:15021/healthz/ready": dial tcp 10.134.1.28:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-mnd7q

Unhealthy

Startup probe failed: Get "http://10.133.1.15:15021/healthz/ready": dial tcp 10.133.1.15:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-mnd7q

ProbeError

Startup probe error: Get "http://10.133.1.15:15021/healthz/ready": dial tcp 10.133.1.15:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vrgzs

Unhealthy

Startup probe failed: Get "http://10.132.1.29:15021/healthz/ready": dial tcp 10.132.1.29:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vrgzs

ProbeError

Startup probe error: Get "http://10.132.1.29:15021/healthz/ready": dial tcp 10.132.1.29:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-666b4

Unhealthy

Startup probe failed: Get "http://10.134.1.28:15021/healthz/ready": dial tcp 10.134.1.28:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulDelete

Deleted pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

ProbeError

Readiness probe error: Get "http://10.133.0.219:8080/ready": dial tcp 10.133.0.219:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kzsj7

Unhealthy

Readiness probe failed: Get "http://10.133.0.219:8080/ready": dial tcp 10.133.0.219:8080: connect: connection refused
(x3)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-kzsj7

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w0-a07a90-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a07a90-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-gbfmn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97

SuccessfulDelete

Deleted pod: e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-c7z9k

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-ac338d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-ac338d-openshift-default-d94664777 from 4 to 3

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulDelete

Deleted pod: e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

Unhealthy

Readiness probe failed: Get "http://10.133.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-jrljw

ProbeError

Readiness probe error: Get "http://10.133.0.199:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-extmod-a-850433-openshift-default-7584745dd9

SuccessfulDelete

Deleted pod: e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-850433-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-850433-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-850433-openshift-default-7584745dd9 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulDelete

Deleted pod: e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-ac338d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-ac338d-openshift-default-d94664777 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

Unhealthy

Readiness probe failed: Get "http://10.134.0.218:15021/healthz/ready": read tcp 10.134.0.2:53502->10.134.0.218:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-kld27

ProbeError

Readiness probe error: Get "http://10.134.0.218:15021/healthz/ready": read tcp 10.134.0.2:53502->10.134.0.218:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-75xd9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-883a9e-545cdf9bd9-kf4t9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-883a9e-6f759c5bc5-8cldq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-49d7e5-99dbd976f-6vr6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-49d7e5-openshift-default-6567775c79-hh7cs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-49d7e5-56895dc9f9-vwjz2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7f20f7-d7cc67c75-vdjtg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-883a9e-openshift-default-567bfd88dc-gvwpn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7f20f7-795ff8bb47-6xxnb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-056a96-68fcb4b5c9-h8n6j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-056a96-6d9bf47485-58kz6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-7f20f7-openshift-default-87bd658df-v977k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-dfvjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-056a96-openshift-default-777fc45c8c-jkhd5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-e62935-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-e62935-openshift-default-7684cbb99f from 2 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e62935-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-fdacdb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-fdacdb-openshift-default-5955cd97bf from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fdacdb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf

SuccessfulDelete

Deleted pod: e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

openshift-ingress

deployment-controller

e2e-extmod-b-d4d8c2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d4d8c2-openshift-default-c64d656b5 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d4d8c2-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5

SuccessfulDelete

Deleted pod: e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-7sjhg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-9tjnh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-5k7jd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulDelete

Deleted pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulDelete

Deleted pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w3-8e90c5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-8e90c5-openshift-default-85b7d7485f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x9mrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sjthm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulDelete

Deleted pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-h7zcq

openshift-ingress

replicaset-controller

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f

SuccessfulDelete

Deleted pod: e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-q6rc6

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-8e90c5-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulDelete

Deleted pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-dr4b2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-ac338d-openshift-default-d94664777

SuccessfulDelete

Deleted pod: e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

openshift-ingress

deployment-controller

e2e-extmod-b-ac338d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-ac338d-openshift-default-d94664777 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ac338d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

ProbeError

Readiness probe error: Get "http://10.134.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

Unhealthy

Readiness probe failed: Get "http://10.134.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

Unhealthy

Readiness probe failed: Get "http://10.132.1.6:15021/healthz/ready": dial tcp 10.132.1.6:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-s5msv

ProbeError

Readiness probe error: Get "http://10.132.1.6:15021/healthz/ready": dial tcp 10.132.1.6:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-8ed55a-openshift-default-55cf654d4c-wl24v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-29d09b-openshift-default-56b588f5c5-mmndr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c7d6-67775dcc4f-nmv5p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-8ed55a-db6c776cf-vdsjh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-8ed55a-646db6d969-nx6hq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-29d09b-7b5fb8444c-ndv65

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-29d09b-7ccd86d88f-z59wd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-70c7d6-openshift-default-7f7f5bb95-57266

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c7d6-7887bfd775-2lqfx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-537652-7d5c567859-n28j4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-537652-5dd9974447-tfbxg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-mt-c6e808d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c6e808d7-openshift-default-7969d758df from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-c6e808d7-openshift-default-7969d758df

SuccessfulCreate

Created pod: e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

openshift-ingress

gateway_labeler_controller

e2e-mt-c6e808d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c6e808d7

openshift-ingress

multus

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6e808d7-6fd7b8946f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6e808d7: serviceaccount "payload-processing-e2e-mt-c6e808d7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c6e808d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6e808d7-6fd7b8946f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c6e808d7-6fd7b8946f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6e808d7: serviceaccount "payload-processing-e2e-mt-c6e808d7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c6e808d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c6e808d7-6fd7b8946f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk

AddedInterface

Add eth0 [10.134.1.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

AddedInterface

Add eth0 [10.134.1.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-537652-openshift-default-746478548f-zvwjz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d87781-68568f5fc-ckk2z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d87781-5574866475-bskp6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6e808d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6e808d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-d87781-openshift-default-57f799fb65-dlcgp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6e808d7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6e808d7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-d4d8c2-openshift-default-c64d656b5-l4dk2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-955dc3-567769895c-s4dwc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-955dc3-7ddf4c859-wdc9d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d4d8c2-7584b574f9-vtmnf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d4d8c2-5c9965d747-pdjmx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-955dc3-openshift-default-76559d4f5c-4qqrg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-359f71-openshift-default-7cbcf59687-rjmvn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-359f71-754cff6775-smzzs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-359f71-6976dfcb89-tw2nf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-909268-5ccf8444c9-49wkg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-909268-6f94f47577-cv6fk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2858fb-84ff44d7c9-5vrkl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2858fb-6749b44d75-mjvsd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6e808d7-7bc6ffddf5-s7hnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c6e808d7-6fd7b8946f-jctwk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-909268-openshift-default-846d5db8fc-r66k9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-2858fb-openshift-default-f6599f46f-nc5q2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-c6e808d7-openshift-default-7969d758df-nrqp9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-8e90c5-865b959567-xjrj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-8e90c5-75f87f7845-bbfrx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e62935-76c4db8dc-5p6lh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e62935-5689cd54bf-g9tmd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-e62935-openshift-default-7684cbb99f-2zp94

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-8e90c5-openshift-default-85b7d7485f-bb5hn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a07a90-685b6d6d59-gcv58

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a07a90-f77b5cbdc-pskmz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2wkww

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-2wkww

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w0-a07a90-openshift-default-7bfb466c97-b6rwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d9e067-5dfc99456c-nf5kl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d9e067-65c5df4dd9-5vfl5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-5c109b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859

SuccessfulCreate

Created pod: e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

openshift-ingress

deployment-controller

e2e-shared-b-w1-5c109b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859 from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

AddedInterface

Add eth0 [10.133.1.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

Unhealthy

Startup probe failed: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fc9316-6d8f9ff5f9-xfdqb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

ProbeError

Startup probe error: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-fc9316-openshift-default-58b7b57d89

SuccessfulCreate

Created pod: e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-fc9316-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fc9316-openshift-default-58b7b57d89 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-fc9316-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

AddedInterface

Add eth0 [10.134.1.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d9e067-openshift-default-7487dcb7c7-lf7gc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fc9316-7866c6c76c-nxlrw

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.80:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

ProbeError

Startup probe error: Get "http://10.134.1.37:15021/healthz/ready": dial tcp 10.134.1.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Unhealthy

Startup probe failed: Get "http://10.134.1.37:15021/healthz/ready": dial tcp 10.134.1.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fdacdb-847666b4ff-wktsw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fdacdb-6dfcc5477c-7n7vb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-clnjv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-fc9316-openshift-default-58b7b57d89-vmsts

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-fdacdb-openshift-default-5955cd97bf-sqdz9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-dqqvx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dqqvx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w5m48

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-w5m48

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-zqd94

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 10 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-666b4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-666b4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-zqd94

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-065de0-openshift-default-64f779b7-hkv7v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-065de0-656c4dc6b5-m7n2s

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.148:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-065de0-7b998bf94c-w5scs

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.147:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-7609-6f4f1c

Started

Container started

opendatahub

kubelet

test-curl-7609-6f4f1c

Created

Container created

opendatahub

multus

test-curl-7609-6f4f1c

AddedInterface

Add eth0 [10.134.1.38/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-6f4f1c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7609-981f08

AddedInterface

Add eth0 [10.134.1.39/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-6f4f1c

Killing

Stopping container test-curl-7609-6f4f1c

opendatahub

kubelet

test-curl-7609-981f08

Started

Container started

opendatahub

kubelet

test-curl-7609-981f08

Created

Container created

opendatahub

kubelet

test-curl-7609-981f08

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

AddedInterface

Add eth0 [10.134.1.40/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-b-w4-20109d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-20109d-openshift-default-fdcf648d5 from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-20109d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5

SuccessfulCreate

Created pod: e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

opendatahub

kubelet

test-curl-7609-981f08

Killing

Stopping container test-curl-7609-981f08
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ef1b6-55ccc79d7f-66p76

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ef1b6-5d8d55789c-5hhmn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-7ef1b6-openshift-default

FailedUpdateStatus

horizontalpodautoscalers.autoscaling "e2e-shared-b-w2-7ef1b6-openshift-default" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-7ef1b6-openshift-default

FailedGetScale

deployments.apps "e2e-shared-b-w2-7ef1b6-openshift-default" not found

openshift-ingress

kubelet

e2e-shared-b-w2-7ef1b6-openshift-default-9f5d75d5f-6m9vd

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

Unhealthy

Startup probe failed: Get "http://10.134.1.40:15021/healthz/ready": dial tcp 10.134.1.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

ProbeError

Startup probe error: Get "http://10.134.1.40:15021/healthz/ready": dial tcp 10.134.1.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-4c61c8-9dc48565f-fh957

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

AddedInterface

Add eth0 [10.134.1.45/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-099583-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-099583-openshift-default-59874d54f

SuccessfulCreate

Created pod: e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

openshift-ingress

deployment-controller

e2e-shared-a-w1-099583-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-099583-openshift-default-59874d54f from 1 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

Unhealthy

Startup probe failed: Get "http://10.134.1.45:15021/healthz/ready": dial tcp 10.134.1.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

ProbeError

Startup probe error: Get "http://10.134.1.45:15021/healthz/ready": dial tcp 10.134.1.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-4c61c8-577656bb65-k2z2w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-850433-7c84b7db7c-58vjp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-850433-66886bbf87-qtlnw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-850433-openshift-default-7584745dd9-pm9dp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947

SuccessfulCreate

Created pod: e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-4c61c8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-4c61c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-4c61c8-openshift-default-64bcc6f947 from 1 to 3

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

AddedInterface

Add eth0 [10.132.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

AddedInterface

Add eth0 [10.133.1.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ac338d-767b8df89c-2qjtn

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

Unhealthy

Startup probe failed: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

ProbeError

Startup probe error: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-zzcl8

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

ProbeError

Startup probe error: Get "http://10.133.1.55:15021/healthz/ready": dial tcp 10.133.1.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-x98m7

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-worker-w2-4c61c8-openshift-default-64bcc6f947-2ncv6

Unhealthy

Startup probe failed: Get "http://10.133.1.55:15021/healthz/ready": dial tcp 10.133.1.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ac338d-5cfd9848b7-qt6x6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.191:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-c738e0-openshift-default-8ff7b4997-2f2dq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-c738e0-748956ddd7-vncm6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-c738e0-6856cdb979-52qxw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0db47e-979769587-ckzz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0db47e-9695866b9-xxxnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-ac338d-openshift-default-d94664777-nl82c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-0db47e-openshift-default-ffcc9464f-vf8k4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w4-9908e8-openshift-default-df58d4c65-ghg7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-9908e8-955f5c679-2r5sd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-9908e8-6f794966f5-69xbx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-7n5dq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-099583-openshift-default-59874d54f-w6tqv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-hn986

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-099583-b94d76f8c-r9575

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-099583-568499c68c-nf6zt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-20109d-openshift-default-fdcf648d5-69pcd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-20109d-699d485b79-c87cm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vrgzs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-vrgzs
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-wv8km

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-20109d-6955788f79-7t47f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-5c109b-openshift-default-7b95fb8859-w5z87

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-5c109b-6c8b4fbc45-9nc8g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b85343-657658f49f-ddn8p

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-5c109b-55dfb5db7-2zxvt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-99bdb8-7668c8f687-lk2wd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-99bdb8-84d64f99f5-kcp78

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-99bdb8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85

SuccessfulCreate

Created pod: e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

openshift-ingress

deployment-controller

e2e-worker-w4-99bdb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-99bdb8-openshift-default-6d57d84b85 from 1 to 3

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

AddedInterface

Add eth0 [10.133.1.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

AddedInterface

Add eth0 [10.134.1.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

Created

Container created
(x3)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

Unhealthy

Startup probe failed: Get "http://10.133.1.58:15021/healthz/ready": dial tcp 10.133.1.58:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

ProbeError

Startup probe error: Get "http://10.134.1.46:15021/healthz/ready": dial tcp 10.134.1.46:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

Unhealthy

Startup probe failed: Get "http://10.134.1.46:15021/healthz/ready": dial tcp 10.134.1.46:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

ProbeError

Startup probe error: Get "http://10.133.1.58:15021/healthz/ready": dial tcp 10.133.1.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-9btkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-bj5nf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-99bdb8-openshift-default-6d57d84b85-jb764

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b85343-69fbff6447-d54td

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-b85343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b85343-openshift-default-7f5cd764b9 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-b85343-openshift-default-7f5cd764b9

SuccessfulCreate

Created pod: e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

openshift-ingress

multus

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

AddedInterface

Add eth0 [10.134.1.47/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b85343-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-sv8v6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w1-b85343-openshift-default-dockercfg-jnjww); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w1-b85343-openshift-default-7f5cd764b9-7pfjj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-0e3bc4e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0e3bc4e3

openshift-ingress

replicaset-controller

e2e-ait-0e3bc4e3-openshift-default-6f994578c9

SuccessfulCreate

Created pod: e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

openshift-ingress

deployment-controller

e2e-ait-0e3bc4e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0e3bc4e3-openshift-default-6f994578c9 from 0 to 1

openshift-ingress

multus

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

AddedInterface

Add eth0 [10.134.1.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0e3bc4e3: serviceaccount "payload-processing-e2e-ait-0e3bc4e3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0e3bc4e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0e3bc4e3-5dd474dd85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0e3bc4e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0e3bc4e3: serviceaccount "payload-processing-e2e-ait-0e3bc4e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

AddedInterface

Add eth0 [10.134.1.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

AddedInterface

Add eth0 [10.134.1.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-mnd7q
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-mnd7q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e3bc4e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e3bc4e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Unhealthy

Readiness probe failed: Get "http://10.134.1.48:15021/healthz/ready": read tcp 10.134.0.2:39722->10.134.1.48:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

ProbeError

Readiness probe error: Get "http://10.134.1.48:15021/healthz/ready": read tcp 10.134.0.2:39722->10.134.1.48:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

ProbeError

Startup probe error: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Unhealthy

Startup probe failed: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e3bc4e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-0e3bc4e3-5dd474dd85-bqq7r

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e3bc4e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e3bc4e3-69bd6574d7-f9942

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Killing

Stopping container istio-proxy

opendatahub

kubelet

maas-controller-bc8c7d7fb-9crlh

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-bc8c7d7fb

SuccessfulDelete

Deleted pod: maas-controller-bc8c7d7fb-9crlh

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

Unhealthy

Readiness probe failed: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-0e3bc4e3-openshift-default-6f994578c9-5rmt2

ProbeError

Readiness probe error: Get "http://10.134.1.48:15021/healthz/ready": dial tcp 10.134.1.48:15021: connect: connection refused body:

opendatahub

replicaset-controller

maas-controller-bc8c7d7fb

SuccessfulCreate

Created pod: maas-controller-bc8c7d7fb-b9ncb

opendatahub

kubelet

maas-controller-bc8c7d7fb-b9ncb

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d" in 404ms (404ms including waiting). Image size: 200095252 bytes.

opendatahub

multus

maas-controller-bc8c7d7fb-b9ncb

AddedInterface

Add eth0 [10.134.1.52/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-bc8c7d7fb-b9ncb

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d"

opendatahub

kubelet

maas-controller-bc8c7d7fb-b9ncb

Created

Container created

opendatahub

kubelet

maas-controller-bc8c7d7fb-b9ncb

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 4 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-t297d

AddedInterface

Add eth0 [10.134.1.53/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-w99jj

AddedInterface

Add eth0 [10.134.1.54/23] from ovn-kubernetes

opendatahub

maas-controller-bc8c7d7fb-b9ncb_2bbcb29c-7699-4d55-b98b-9f495257c0f5

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc8c7d7fb-b9ncb_2bbcb29c-7699-4d55-b98b-9f495257c0f5 became leader
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

Unhealthy

Startup probe failed: Get "http://10.134.1.53:15021/healthz/ready": dial tcp 10.134.1.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

ProbeError

Startup probe error: Get "http://10.134.1.53:15021/healthz/ready": dial tcp 10.134.1.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

Unhealthy

Startup probe failed: Get "http://10.134.1.54:15021/healthz/ready": dial tcp 10.134.1.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

ProbeError

Startup probe error: Get "http://10.134.1.54:15021/healthz/ready": dial tcp 10.134.1.54:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

Unhealthy

Startup probe failed: Get "http://10.134.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-w99jj

ProbeError

Startup probe error: Get "http://10.134.1.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

Unhealthy

Startup probe failed: Get "http://10.134.1.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-t297d

ProbeError

Startup probe error: Get "http://10.134.1.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

maas-controller-bc8c7d7fb-b9ncb

Killing

Stopping container manager
(x2)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-bc8c7d7fb from 1 to 0

opendatahub

replicaset-controller

maas-controller-bc8c7d7fb

SuccessfulDelete

Deleted pod: maas-controller-bc8c7d7fb-b9ncb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-dhv97
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 6 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-gknbx

AddedInterface

Add eth0 [10.133.1.59/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-hstf4

AddedInterface

Add eth0 [10.132.1.38/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-dhv97

AddedInterface

Add eth0 [10.134.1.55/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-msgxv

AddedInterface

Add eth0 [10.134.1.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-bc8c7d7fb from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

Started

Container started

opendatahub

replicaset-controller

maas-controller-bc8c7d7fb

SuccessfulCreate

Created pod: maas-controller-bc8c7d7fb-gcc5b

opendatahub

multus

maas-controller-bc8c7d7fb-gcc5b

AddedInterface

Add eth0 [10.134.1.57/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-bc8c7d7fb-gcc5b

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d"

opendatahub

kubelet

maas-controller-bc8c7d7fb-gcc5b

Created

Container created

opendatahub

kubelet

maas-controller-bc8c7d7fb-gcc5b

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e9fbe5b085bf2f5bb410417303f34b2623e2696582946ab6dc4545d1d07b751d" in 428ms (428ms including waiting). Image size: 200095252 bytes.

opendatahub

kubelet

maas-controller-bc8c7d7fb-gcc5b

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

Unhealthy

Startup probe failed: Get "http://10.132.1.38:15021/healthz/ready": dial tcp 10.132.1.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

ProbeError

Startup probe error: Get "http://10.133.1.59:15021/healthz/ready": dial tcp 10.133.1.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

Unhealthy

Startup probe failed: Get "http://10.134.1.55:15021/healthz/ready": dial tcp 10.134.1.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

ProbeError

Startup probe error: Get "http://10.132.1.38:15021/healthz/ready": dial tcp 10.132.1.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

ProbeError

Startup probe error: Get "http://10.134.1.55:15021/healthz/ready": dial tcp 10.134.1.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

Unhealthy

Startup probe failed: Get "http://10.133.1.59:15021/healthz/ready": dial tcp 10.133.1.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

ProbeError

Startup probe error: Get "http://10.134.1.56:15021/healthz/ready": dial tcp 10.134.1.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

Unhealthy

Startup probe failed: Get "http://10.134.1.56:15021/healthz/ready": dial tcp 10.134.1.56:15021: connect: connection refused

opendatahub

maas-controller-bc8c7d7fb-gcc5b_449cbfa1-0111-497f-8c8b-9394bccff5dc

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-bc8c7d7fb-gcc5b_449cbfa1-0111-497f-8c8b-9394bccff5dc became leader

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.Deployment llm/e2e-prio-pool-a77df7ec-kserve

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.RoleBinding llm/e2e-prio-pool-a77df7ec-epp-rb

llm

replicaset-controller

e2e-prio-pool-a77df7ec-kserve-564dd8d759

SuccessfulCreate

Created pod: e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.Service llm/e2e-prio-pool-a77df7ec-epp-service

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.ServiceAccount llm/e2e-prio-pool-a77df7ec-epp-sa

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.ClusterRoleBinding /llm-e2e-prio-pool-a77df7ec-epp-auth-rb

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.Service llm/e2e-prio-pool-a77df7ec-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.Role llm/e2e-prio-pool-a77df7ec-epp-role

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.Secret llm/e2e-prio-pool-a77df7ec-kserve-self-signed-certs

llm

deployment-controller

e2e-prio-pool-a77df7ec-kserve

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-a77df7ec-kserve-564dd8d759 from 0 to 1

llm

deployment-controller

e2e-prio-pool-a77df7ec-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4 from 0 to 1

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

Created v1.Deployment llm/e2e-prio-pool-a77df7ec-kserve-router-scheduler

llm

replicaset-controller

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4

SuccessfulCreate

Created pod: e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

llm

multus

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

AddedInterface

Add eth0 [10.134.1.59/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Pulling

Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827"

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

Started

Container started

llm

multus

e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

AddedInterface

Add eth0 [10.134.1.58/23] from ovn-kubernetes

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

Created

Container created

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x9)

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Created

(combined from similar events): Created v1.DestinationRule llm/e2e-prio-pool-a77df7ec-kserve-shadow-svc

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Updated

Updated v1.HTTPRoute llm/e2e-prio-pool-a77df7ec-kserve-route

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Created

Container created

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Started

Container started

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker@sha256:5fe24a45d9c8039b6db33e8be331dab766610e6eb60f9d2bec1ecc1153ca8827" in 1.609s (1.609s including waiting). Image size: 184206420 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Updated

Updated v1.Secret llm/e2e-prio-pool-a77df7ec-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

LLMInferenceServiceReady

LLMInferenceService [e2e-prio-pool-a77df7ec] is Ready

llm

LLMInferenceServiceController

e2e-prio-pool-a77df7ec

Deleted

Deleted v1.ClusterRoleBinding /llm-e2e-prio-pool-a77df7ec-epp-auth-rb

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-564dd8d759-x4mlh

Killing

Stopping container main

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Killing

Stopping container main

openshift-ingress

deployment-controller

e2e-worker-single-main-b9d7ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b5

SuccessfulCreate

Created pod: e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-b9d7ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-b9d7ac

openshift-ingress

multus

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

AddedInterface

Add eth0 [10.132.1.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-b9d7ac: serviceaccount "payload-processing-e2e-worker-single-main-b9d7ac" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-b9d7ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-b9d7ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-b9d7ac: serviceaccount "payload-processing-e2e-worker-single-main-b9d7ac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

openshift-ingress

multus

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

AddedInterface

Add eth0 [10.133.1.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

AddedInterface

Add eth0 [10.133.1.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Unhealthy

Readiness probe failed: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

ProbeError

Readiness probe error: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

ProbeError

Startup probe error: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Unhealthy

Startup probe failed: Get "http://10.132.1.45:15021/healthz/ready": dial tcp 10.132.1.45:15021: connect: connection refused
(x5)

llm

kubelet

e2e-prio-pool-a77df7ec-kserve-router-scheduler-86b8f66dc4-899bf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-b9d7ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-b9d7ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-b9d7ac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-b9d7ac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d96cmf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8bhr76

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-b9d7ac: serviceaccount "payload-processing-e2e-worker-single-main-b9d7ac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-b9d7ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f897bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-b9d7ac: serviceaccount "payload-processing-e2e-worker-single-main-b9d7ac" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-b9d7ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-b9d7ac-68d9d486d7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

AddedInterface

Add eth0 [10.134.1.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n

AddedInterface

Add eth0 [10.134.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-b9d7ac-f86f8g8ghd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-b9d7ac-68d9d486dztz4n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-b9d7ac-openshift-default-57778fb5b59l4cb

Killing

Stopping container istio-proxy

llm

replicaset-controller

e2e-same-id-a-e3903940-kserve-57bf6cdf89

SuccessfulCreate

Created pod: e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.Service llm/e2e-same-id-a-e3903940-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.Deployment llm/e2e-same-id-a-e3903940-kserve

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.Secret llm/e2e-same-id-a-e3903940-kserve-self-signed-certs

llm

deployment-controller

e2e-same-id-a-e3903940-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-a-e3903940-kserve-57bf6cdf89 from 0 to 1

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.PodMonitor llm/e2e-same-id-a-e3903940-kserve-llmisvc-engine-default

llm

kubelet

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

Started

Container started

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.PodMonitor llm/e2e-same-id-a-e3903940-kserve-llmisvc-engine

llm

multus

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

AddedInterface

Add eth0 [10.134.1.64/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.DestinationRule llm/e2e-same-id-a-e3903940-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.HTTPRoute llm/e2e-same-id-a-e3903940-kserve-route

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Created

Created v1.NetworkPolicy llm/e2e-same-id-a-e3903940-prometheus-scraping

llm

kubelet

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod

llm

kubelet

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

Created

Container created

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

Updated

Updated v1.Secret llm/e2e-same-id-a-e3903940-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-a-e3903940] is Ready

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.Secret llm/e2e-same-id-b-e3903940-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.Deployment llm/e2e-same-id-b-e3903940-kserve

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.Service llm/e2e-same-id-b-e3903940-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.NetworkPolicy llm/e2e-same-id-b-e3903940-prometheus-scraping

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.PodMonitor llm/e2e-same-id-b-e3903940-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.HTTPRoute llm/e2e-same-id-b-e3903940-kserve-route

llm

deployment-controller

e2e-same-id-b-e3903940-kserve

ScalingReplicaSet

Scaled up replica set e2e-same-id-b-e3903940-kserve-6ccffbd59c from 0 to 1

llm

replicaset-controller

e2e-same-id-b-e3903940-kserve-6ccffbd59c

SuccessfulCreate

Created pod: e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.DestinationRule llm/e2e-same-id-b-e3903940-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Created

Created v1.PodMonitor llm/e2e-same-id-b-e3903940-kserve-llmisvc-engine-default

llm

kubelet

e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

Created

Container created

llm

kubelet

e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

Started

Container started

llm

multus

e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

AddedInterface

Add eth0 [10.134.1.65/23] from ovn-kubernetes

llm

kubelet

e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod
(x2)

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

Updated

Updated v1.Secret llm/e2e-same-id-b-e3903940-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

LLMInferenceServiceReady

LLMInferenceService [e2e-same-id-b-e3903940] is Ready
(x3)

llm

LLMInferenceServiceController

e2e-same-id-a-e3903940

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-e3903940 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-e3903940; safe to ignore if traffic splitting is planned
(x7)

llm

LLMInferenceServiceController

e2e-same-id-b-e3903940

ModelNameCollision

model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-e3903940 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-e3903940; safe to ignore if traffic splitting is planned

llm

kubelet

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

Killing

Stopping container main

llm

kubelet

e2e-same-id-b-e3903940-kserve-6ccffbd59c-6jfkz

Killing

Stopping container main
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

Unhealthy

Readiness probe failed: Get "http://10.134.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-dhv97

ProbeError

Readiness probe error: Get "http://10.134.1.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-same-id-a-e3903940-kserve-57bf6cdf89-vz8pv

Unhealthy

Readiness probe failed: Get "https://10.134.1.64:8000/ready": dial tcp 10.134.1.64:8000: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-b5668cfcb

SuccessfulCreate

Created pod: payload-pre-processing-b5668cfcb-2xmwb

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-b5668cfcb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-b5668cfcb-2xmwb

Created

Container created

openshift-ingress

multus

payload-pre-processing-b5668cfcb-2xmwb

AddedInterface

Add eth0 [10.134.1.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-b5668cfcb-2xmwb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-b5668cfcb-2xmwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulDelete

Deleted pod: payload-pre-processing-7b98bb678c-4m2w6

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-4m2w6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-7b98bb678c from 1 to 0

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-b7f977d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-b7f977d8

SuccessfulCreate

Created pod: payload-processing-b7f977d8-nps9f

openshift-ingress

kubelet

payload-processing-b7f977d8-nps9f

Created

Container created

openshift-ingress

kubelet

payload-processing-b7f977d8-nps9f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-b7f977d8-nps9f

Started

Container started

openshift-ingress

multus

payload-processing-b7f977d8-nps9f

AddedInterface

Add eth0 [10.134.1.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-55fbbbf9dc from 1 to 0

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulDelete

Deleted pod: payload-processing-55fbbbf9dc-885tl

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-885tl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-846db64bd8-6tnsj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-846db64bd8-6tnsj

Started

Container started

openshift-ingress

multus

payload-pre-processing-75b7db44c9-qzv2n

AddedInterface

Add eth0 [10.134.1.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-75b7db44c9-qzv2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-846db64bd8-6tnsj

AddedInterface

Add eth0 [10.134.1.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-846db64bd8-6tnsj

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-846db64bd8

SuccessfulCreate

Created pod: payload-processing-846db64bd8-6tnsj

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-846db64bd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-75b7db44c9

SuccessfulCreate

Created pod: payload-pre-processing-75b7db44c9-qzv2n

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-75b7db44c9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-75b7db44c9-qzv2n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-75b7db44c9-qzv2n

Created

Container created

openshift-ingress

kubelet

payload-processing-b7f977d8-nps9f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-b5668cfcb-2xmwb

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-b5668cfcb

SuccessfulDelete

Deleted pod: payload-pre-processing-b5668cfcb-2xmwb

openshift-ingress

replicaset-controller

payload-processing-b7f977d8

SuccessfulDelete

Deleted pod: payload-processing-b7f977d8-nps9f

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled down replica set payload-processing-b7f977d8 from 1 to 0

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled down replica set payload-pre-processing-b5668cfcb from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

SuccessfulCreate

Created pod: payload-processing-external-model-5bcd7997-x6mgv

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bcd7997 from 0 to 1
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bcd7997

FailedCreate

Error creating: pods "payload-processing-external-model-5bcd7997-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-x6mgv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-x6mgv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-x6mgv

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5bcd7997-x6mgv

AddedInterface

Add eth0 [10.134.1.70/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5bcd7997-x6mgv

Killing

Stopping container payload-processing

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Error

Reconciliation failed: failed to reconcile monitoring resources: failed to reconcile VLLM engine monitor: failed to reconcile vLLM engine monitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default: failed to get defaults for v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default: Internal error occurred: failed calling webhook "podmonitor-injector.opendatahub.io": failed to call webhook: Post "https://opendatahub-operator-controller-manager-service.opendatahub-operator-system.svc:443/mutate-prometheus-monitors?timeout=10s": context deadline exceeded

openshift-ingress

gateway_labeler_controller

e2e-worker-single-main-462c10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-single-main-462c10

openshift-ingress

replicaset-controller

e2e-worker-single-main-462c10-openshift-default-67dc98df7c

SuccessfulCreate

Created pod: e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

openshift-ingress

deployment-controller

e2e-worker-single-main-462c10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-single-main-462c10-openshift-default-67dc98df7c from 0 to 1

openshift-ingress

multus

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

AddedInterface

Add eth0 [10.134.1.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-462c10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-462c10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-462c10-6b787884ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-462c10: serviceaccount "payload-processing-e2e-worker-single-main-462c10" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-462c10-6b787884ff

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-462c10-6b787884ff

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-462c10-6b787884ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-462c10: serviceaccount "payload-processing-e2e-worker-single-main-462c10" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

AddedInterface

Add eth0 [10.134.1.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

AddedInterface

Add eth0 [10.134.1.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Started

Container started

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

ProbeError

Readiness probe error: Get "http://10.134.1.71:15021/healthz/ready": dial tcp 10.134.1.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Unhealthy

Readiness probe failed: Get "http://10.134.1.71:15021/healthz/ready": dial tcp 10.134.1.71:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Unhealthy

Startup probe failed: Get "http://10.134.1.71:15021/healthz/ready": dial tcp 10.134.1.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

ProbeError

Startup probe error: Get "http://10.134.1.71:15021/healthz/ready": dial tcp 10.134.1.71:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-462c10-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-462c10-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-462c10-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-single-main-462c10-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fn8g25

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dtss5b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-462c10: serviceaccount "payload-processing-e2e-worker-single-main-462c10" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-462c10-6b787884ff

SuccessfulCreate

Created pod: payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-single-main-462c10-6b787884ff

FailedCreate

Error creating: pods "payload-processing-e2e-worker-single-main-462c10-6b787884ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-single-main-462c10: serviceaccount "payload-processing-e2e-worker-single-main-462c10" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-single-main-462c10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-single-main-462c10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-single-main-462c10-6b787884ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

AddedInterface

Add eth0 [10.134.1.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-single-main-462c10-6448d99c79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42

AddedInterface

Add eth0 [10.134.1.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-single-main-462c10-6448dpt8nd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-single-main-462c10-6b787884fbwd42

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-single-main-462c10-openshift-default-67dc98df7c8qhlw

Killing

Stopping container istio-proxy

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-678d87766f from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-678d87766f-89stt

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-89stt

Killing

Stopping container manager
(x2)

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-f4r7b

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-f4r7b

AddedInterface

Add eth0 [10.133.1.65/23] from ovn-kubernetes

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-f4r7b_c2e0c610-a5d7-4526-bd83-a1e59b649b48

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-f4r7b_c2e0c610-a5d7-4526-bd83-a1e59b649b48 became leader
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

ProbeError

Readiness probe error: Get "http://10.133.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-44ncj

Unhealthy

Readiness probe failed: Get "http://10.133.0.208:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-rcjbb

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

Unhealthy

Readiness probe failed: Get "http://10.134.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

ProbeError

Readiness probe error: Get "http://10.133.1.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-gknbx

Unhealthy

Readiness probe failed: Get "http://10.133.1.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

Unhealthy

Readiness probe failed: Get "http://10.132.1.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hstf4

ProbeError

Readiness probe error: Get "http://10.132.1.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-msgxv

ProbeError

Readiness probe error: Get "http://10.134.1.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

Unhealthy

Readiness probe failed: Get "http://10.132.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

ProbeError

Readiness probe error: Get "http://10.132.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hn6jd

ProbeError

Readiness probe error: Get "http://10.132.1.8:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-cdvd9

Unhealthy

Readiness probe failed: Get "http://10.132.1.7:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-kbvsh

Pulled

Container image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-kbvsh

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-kbvsh

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

authorino-operator-7b7bb4bc77-kbvsh_0af5cdda-0ad7-4904-91c9-5156770c3272

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-kbvsh_0af5cdda-0ad7-4904-91c9-5156770c3272 became leader

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-f4r7b_233f1c21-9c5f-4121-a5e6-2ba9c0a71269

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-f4r7b_233f1c21-9c5f-4121-a5e6-2ba9c0a71269 became leader
(x4)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x5)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x4)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x3)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f4r7b

BackOff

Back-off restarting failed container manager in pod kuadrant-operator-controller-manager-678d87766f-f4r7b_kuadrant-system(3b3a7806-8c9f-4e02-9848-cc488d0622ba)
(x3)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f4r7b

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x3)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f4r7b

Created

Container created
(x3)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-f4r7b

Started

Container started
(x4)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-f4r7b_6996506e-9217-417d-888b-29b64f3da3fb

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-f4r7b_6996506e-9217-417d-888b-29b64f3da3fb became leader